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ABSTRACT - ' . \ 

The National Institute of -Education is in the process 
of deisigning and conducting a study of compensatory education in 
accordance with the Education Amendments of 197U. Special attention 
will be devoted to examining the relative effectiveness of ^ 
"standardized" versus "individualized" instructional programs. The 
stated purpose df this report is: .(1) to develop^ a conceptual 
framework- within which a meaningful comparison of individualize^ 
versus standardized instruction can.be made; (2) to identify specific* 
variables which need to be assessed; and (3) to develop and describe 
.specific procedures which should be used in gathering, analyzing, and 
reporting the results of the research effort. It is, proposed that^ 
rather tharf attempting to sample schools with uniformly 
"individualized" or "standardized" programs, the sampling procedure 
shou^.d involve a deliberate and systematic attempt to sample programs 
which vary as widely as po^ssible on different dimensions of 
individualization. The) primary sampling unit should be classrooms. 
The central concern of the research j^hould be the accurate 
description of what is being , implemented rather than how well, and a 
careful evaluation of hpw those processes affect student outcomes. 
The analysis and interpretation 'of the study should be directed 
toward providing guidelines and recommendations for policy \ 
information^ and therefore should *focus on program variables\(and not 
merely «the programs)". (Ailthor/JM) 
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I. INTRODUCTION m 

A, BACKGROUND * * * 

The National .Institute of Education is in the process of designing 
and conducting a study of compensatory education in accordance with 
the Ed\xc3^ti&rriiM^d'ments of 1974. One of the nnajor goals of the 
research is to anafyze the effectiveness of different ways of meeting 
children's educational needs. As part of this larger NIE effort, spe- 
cial attention will be devoted to examining the relative effectiveness of 
"standardized*' versus "individualized" instructional programs . 

"Individualized" programs, whjich attempt to tailor instruction ' 
to the individual student needs, have received increasing attention in 
the educational community, and Congress has specif icgilly mandated 
their inclusion in the overall assessment of the effectiveness of differ- 
ent instructional methods used in compensatory programs. 

The results of NIE*s study will be used to provide CongTess 
with specific reconrimendations regarding educational programs and 
ojbjectives, and could form a basis for new legislation. While the 
focus of the present effort is on compensatory educational programs, 
it is expected that the results w.ill^be applicable to a wide range of 
education a l policy questions. The primary purpose of the particular 
research effort that is to be guided by this report is to provide a 
basis for forming policy as opposed to merely evaluating the effective- 
ness of existing programs. The research is not intended to ser.ve as 
a vehicle for making funding decisions about individual programs,' but 
rather is intended to have a broader impact on legislative and program 
decisio]jis regarding compensatory education in gei^eral. 

This research effort is to be primarily an intensive study of ^. 
the effects of individualized instruction ^er se, a!nd other variables are 
of only secondary interest. It is to be an in-depth assessment of the. 
X. actual operation of a small sample of existing programs, rather t|han 
a broad survey representative of compensatory programs as a whole. 
And finally, it is designed to include measures based on actual obser- 
vation of the instructional process in the classroom and its impact dn 

' . ' " ' ^- •> * 

children. ,^ ^ ' ' 

O ^ 
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B. PURPOSE OF THIS REPORT 

In line with the»goal3 described above, the purpose'^of this report 
is (I) to d-evelop a conceptual framework within which a meaningful 
domparison'bf individualized vs /standardized instruction can be made; 
(2) to identify specific variables which need to be'assessed; and (3) to 
develop and describe specifiq procedures which should be used in 
gathering, analyzing and reporting the results of the research effort. 
In Approaching each of th^s^ tasks, CRI.has attempted to describAhe 
practical or theoretical rationale underlying the selection of one 
approacll oyer another. CRI believes that t^his is especially important 
since in many instances the choice of approach is far from obvious, 
and must rest ultimately on decisions regarding research objectives 
and priorities. Thus, adequate documentation of the major considera- 
tions and assumptions underlying the choice of given research strategy 
is essential.' ' < 

C. MAJOR CONSIDERATION AND ASSUMPTIONS AFFECTING THE STUDY DESIGN 

CRI took two major factors into consideration when designing 
the study - the Request for Proposal (RFP) specifications and the 
"State of the Art" as reported in the literature related to individu- 
alized instruction. - 

The approach described in the RFP suggests that the contractor 
begin by defining as precisely as possible two distinct categories into 
which instructional prograrqs could be classified, i.e. individualized 
or standardized » The aim of this approach woji^ld be to compare the 
outcomes for these two treatments, adjusting for all other sources of 
variation which can be measured. These sources would include pro- 
.cess variables not incorpoj^ated within the defini^ionN^f treatments, 
contextual a;id input variables characterizing cl^ssrooinB, 6ch\)ols, 
and communities being studied\ ^ Jb- \ 

Unfortunately, such a comparison would a^sy^er the. q^iestion of . 
which type of treatment is more effective only wA^n operaUhgsunder 



rather restrictive ^^nd unrealistic assumptions. First, if must t>e 
assumed that there fexi^^s a single treatment dimension correspond- 
ing to the concept of indivi^ualizatibn along which programs can be 
ranged. Certainly the literature does not reflect a consensus on 
what such an essential characterization of individualization might be. 
Programs can be assessed injCerms of a number of variables, gener- 
ally agreed to reflect individualization (e. g. , vai-iation in rate of 
progress through a particular set of tasks, or differential assignment 
of materials), but it is not clear >^hether a single treatment dimensibn 
can be me^aningfu-lly defined. 

Second, for the approach suggested in the RFP to be appropri- 
ate, it must be assumed that the treatments being compared are well- 
,definecl entitites which could in principle be replicated in various 
classrooms. That is, whatever "individuali^zed instruction*' is 
defined as, it must be something which is meaningful to talk about 
in general.' The notion is that this "something" can be added to a 
pre-existing situation. ^ * 

:i Again unfortunately, the literatvi^)|^5uggests that this may not 
be the case either. There is often as much variation between class- 
rooms supposedly using the same progratm/as there is between pro- 
grams. This may be due to differences in the way a given {Program 
implemented. Or it may be that there are strong interactiqjns between 
teaching style and curricular approach on the one hand, and various 
contextual and background variables' on the other. For example, it 
may be that a certain teaching method is never successfuljn .certain 
settifigs because of fundamental incompatibilities between the method 
and these settings. 

In light of these prqblems we are faced with a diffic^ilt choice. 
Qne alternative is to ignore tftese potential complexities in the fiope that 
they^will wash out or carl be suitabJ^y handled in tKe analysis. This 
approach would lead us to consider this study in terms of a traditional 
pre-post, treatment versus* control group desig:|> (without randomiza-/^ 
tion). The overall estimate of the treatment effect would be based on 



a comparison of the outcomes for those programs designated 
''standardized*' with the outcomes for those designated "individualized. 
Statistical'adjustments would be used to control for biases related^o 
measured input and contextual yai:iables ^s well as for pre-tes^ dif 
ferences. An overall estimate^ <rf program effect fo^, individualized 
and standardized programs wbuld be calculated and presented along 
with sever^L'caveats , 

On t?h€(:'other extreme, we can begome overwhelmed by the com- 
plexities aW abandon all efforts to provide some sort of definitive , • 
statement it)outnhe effectiveness of individualized instruction. The 
research effort would then risk losing an immediate policy payoff.-^ 
Such a study would be primarily descriptive and would make no seri- 
ous attempt at /causal inference. 

Neither of these extremes are satisfactory fonNIE^s purposes. 
The first is likely to provide a precise answer to the wrong question, 
While the secolid be^s the question altogether. In addition, neither 
pproach seems to provide enough answers to other questions- which 
nferest other Federal, State, and local school district audiences., 
hsse questions are related to:' the various ways to individualize 
^standardize programs; the types of gains produced by the v^ari- 
|p types of programs; the conditions under which certain gains are 
Ipjjyduced; and the facto^rs which affect inriplementafion of certain > ' 
types of programs. 

With or without the results of this study, Congre^ss must make 
^difficult decis'ions with respect to compensatory education in two 
lyears. Therefore, the broad aim of thijs study should be to provide 
much information as possible on the degree to which educational 
Iputcomes might be improved as a result of various policies promot- 
i.ing alternatives to current practice . 

I CRI /Tnds that this goal can best be accomplished in three < 

sequential stages of research. The first s'tage should" focus on the 
problehi of identifying different types of programs- which currently 
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exist in an attemp^t to define "treatments. This would involv^ 
selecting a number of variables that might potentially be used to 
differentiate individu'alijsed from sjt^andardized instruction and 

determining empirically how these variables cluster. 

' ' ^'^** * 

The second s^iage'^should involve assessing the effects of ^le 
above defined "treatments" on student achievement and other impor- 
tant non-cognitive outcomes. - . " 



The third stage should concern estimating the impact of a change 
from one type of curriculum to another fojr a classroom with specified 
characteristics. This would specifically take into account any inter- 
actions that appear to exist between type of curriculuiVi and c^Ptf^xtual 
and input characteri&tics of the classroom. This process would pro-* 
vide the basis for .policy recommendations. 

Thus, the suggested approach' could be considered a compro- 
mise between the t^o extremes in that it daes not banish the notion 
that there is or can be Skjuch a thing as a single unified approach to ^ * 
individualization, but ratfter it subjects that notion .to empiricartestr- 
ing. If in fact individualize id programs do tend to shalre a set of unique 
features which can be formed into a single cluster and if any of thes.e 
clusters do in fact tend to desult^in better outcomes, then that fact will 
become apparent from the data analysis in the study. 

D. - KEY IMPLICATION^OR THE STUDY |)ESIGN 

Several critical consequences follow naturally from the approach 
described above. These'will be mentioned briefly here and developed 
more fully later in the ^reportV ' 

• Rather than attempting to sample schools with uniformly 

"individualized" or "standardized" programs, the sampling 
procedure should involve a deliberate and systematic; 
» attempt to sample programs which vary as widely as pos - 
• ^ sible on different dimensions of individualizatioif. 
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T.he* Literature suggests that there is as much' var taction 
between classrooms that are supposedly using the same* 
instructional pl-ogram (e. g. classrooms using Individ- 
ually Prescribed Instruction, (IPX)), as there is between 
different instructional programs. Therefore, for pur- 
poses of this study, the primary sampling -unit should 
be classrooms rather than programs' (such as IPI) 
which are proported to be utiliz'^'dt . * 

'The notion of how '^well-inaplem^led'* (i. e. , "how closely^ 

the implemerit^ed program matches the original program 

de^gn) a particular plan of individualized instruction is, 

)ecomes less central to the' research than an accurate 

• des*cription of what iss.being implemented'(on the basis 

of actual observational measures), and a careful 
♦* 

' evaluation of how |Jhose processes affect, student out- 
comes, 

The. analysis. and interpretation. of the study should be 
jdifected tow'ai^i providing guidelines and recommenda- 
tions for policy-information which go beyond an eval- 
uation of currently available programs; thus it should 
attempt to provide evidence concerning the effects of 
'.the underlying program variables (and not merely the 
programs) includei^ in the study. - . . 



II. PROJECT CONCEPTUALIZATION • 

in cjrder- to develop an adequate designlor a study, that is directed 
toward providing policy -relevant information^ it is essential to arti- 
culate the fundamental' goils and assumptions very carefully, i. e. , to 
define the.prb^)lems and issues which the study must address. The 
major goajl of, the study is clearly stated in the RFP - -to study the * 
effects , of individualized instruction on compensato^ry education students. 
Ho'wever, before this general goal can be achieved, *the criteria for 
judging effectiveness and definitions of individualized and standardized 
programs must be developed. It is this latter problem that we shall 
take up in this chapter, 

A. ^ CONCEPT OF INDIVIDUALIZATION 

The Rt^P notes that several "individualize^! programs" presently in 
general us^ differ widely in many respects but seem to share certain 
characteristics: • • * 

1. Stated performance objectives. , 

2. Diagnosis of individual student needs with respect £o these 
* objectives. 

3. Regular progress tests. 

4. Use of test finding^ to identify the optimal instruction rate 
for each child, allowing each student to proceed atihis own, 

•rate. • . . 

The RFP identifies #4 above as th-^efssential distinguishing feature *' 
of individualized^ instruction. > 

One of the problems with attempting to isolate '^essential distinguish 
ing features'! of individualized and standardized instruction is that it is 
difficult to find fe^atures which seem to distinguish the twd types taken 
as a whole and are centrally characteristic of either type by itself. As 
the RFP notes, none of the four common characteristics of individual- " 
ized programs, with the exception of f 4, is J:ypically uncharacteristic 



oj standardized programs. HoN^ever, that does not mean 



that 



individualization of instructional rate is the"X)nly important difference 
between the two approaches. Nor does it mean that variations in rate 
according to individual student needs is the^ most irnportant goal of in- 
dividualized programs themselves. 'For example, Lindvall & Cox (1972) 
state^that Individually Prescribed Instruction (IPI) is organized around 
six goals, only one of which is that each student proceed at an optimal 
rate. (The others include active student, involvement, self -Sele^ction 
and self-direction, self -evaluation, variation in techniques and * ' 
materials, and regular progress toward mastery of ^ecified 
objectives. ) • . 

It appears to be easier to distinguish individualized from stand- 
ardized programs on a broad conceptual level than* at the operational 
level. The differences between individualized and standardized pro- 
grams arppear to be largely in their organizing goals and differential 
instructional emphasis. That is, individualized programs tend to em- 
phasise certain instructional approaches whereas standardized pro- 
grams stress others. But there is also wide diversity within the two 
programs, and no single instructional technique can be singled out as 
uniquely defining' fbr either type of program. Instead of searching for 
a single defining feature, it seems more desirable to begin with a con- 
ceptual analysis of individualized programs, based both on a distillatiojt 
of the shared goals and assumptions displayed by existing programs aSS 
a systematic development of the concepts underlying them. Out of this 
analysis a working definition ot individualized programs will emerge 
whicH will .accurately reflect both the real underlying commonalities ' 
and the diversity to be found between and within them. 

1. Towards Defining Individualized Instruction 

For the purposes ot this report ''individualized*' instruction 
will be .differentiated frorri "standardized'' instruction in terms of the 
extent to which the educational program is oriented towards the par- 
ticular and unique characteristics of each student within thkt program 
or classroom. , < 

II.-2 
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' ^ a. .The Sequential Process of Indi.vidualization ^ 

^ ' / ^ 

Central/to CRTs concept of individualization is the 
notion Tthat an individualized c^ogram necessarily. involves three inter- 
related steps. First, a diagnosis of the particular needs o^f, a student 
must take place. Thus a studenji's peculiar or special abilities, 
achievement^ interests and/or home background are taken into account. 
Second, an, educational program which is specially tailored to the' indi- 
vidual student* s presumed optimal learning mode is prescribed. Thirdly, 
.the prescribed treatment or .program is implemented. 

When all th ree above steps have been tak^n in order, we can say 
that there is "individualized" instruction. It should be made clear, 
however, that the major distinction between individualized instructij 
and other type? is not merely whether diagnosis, prescription arKjgi^ 
mentation occur, but when they do occur, whether or not the-f^are f^tused 
on the individual student's needs rather than on the group's ne< 

In considering this sequence of three steps, it is tempting to in- 
clude additional criteria for defining individualization/standardvzation. 
First, it would be possible to form additional criteria concerning the 
basis on which the diagnosis is made,, or the number and kind of student 
characteristics taken into account. It is CRrl contention that while it 
is important to gather this kind of infbrmation, it is not relevant to the 
problem of distinguishing individualized from standardized instruction^ 
There is simply no single set of student chara.cteristics that educators 
agree should be taken into account in rnaking diagnosis, Frapi^the stand- 
pQint of defining individualized instruction, the manner of diagnosis is 
less important than the fact that it was made on the basis of some bpna 
fid^ set of criteria applied to students as individuals. 

It would also be tempting to gather data regarding the assumptions 
underlying the teacher's selection of a given prescription for a particular 
diag nosis; that is, on what basis does Sl teacher decide what educ^,tiona,r 
strategy will best fit a diagnosed need? Again, while this is an interest- 
ing question^in.its own right, it is oiir feeling that it must be considered 
tangential to the problem of studying the effects of individualized instrUc- 
•tion, and therefore lies beyond the scope of the study, 
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In summary, our conception of individualized instriij:tioii. ir^olves 
a sequential process of diagnosis, prescription and implementation 
focused on the individual student's needs/ The. particular basis for the 



diagnosis will not^e considered an important feature in 
vidualized instruction, nor will the nature of the formal 
theory uniierlying choice of prescription, so long as that 
student' prescription is based on the diagnosis. 



efining Kndi- 
or inforiin^l 
individual 



Multidimensional Nature of Individualized Instr 



ction 



1 



The three step sequence described in the preceeaing 
sec^on is considered to be the essential *'core" of individualized in- 
st?Tuctipn. Concretely, however, there are a number ofj ways in whUch 
the process of individualizing instructional treatments c^n be carrie 
out. CRI found it usefuVto distinguish eight derived categor- 

ies of individualized inst^ctional treatments. These categories were\ 
developed on the basis of a^vie>y of relevant literature! and validated ^ 
through an initiaFteleghone sanvey, through which CRI obtained infor 



.^t 



ices. 



mation from teachers about 'meir actu^al instructional pr 

Individualized instruodiion cao be differentiated by varying (1) the 

content or objectives different students are expected to naster; (2) the 
* / 

rate at which different students are. expected to proceed through identical 
objectives and (3) the yfequence in which a given set of objectives are 
pres.crib^ed for different students. In addition, when.d.if Cfijrent studentjs 



are working on the /ame objective, individualized insti 
differentiated by varying (4) the materials that different 
lized^ (5) th,€ teacher behavior en^ployed with the differ 

(6) the student ;X)ehavior that is expected from different 

I— 

(7) the socig-l setting and (8) physical setting in which learning for 
different students takes place. 



lection can be 
students uti- 
nt students, 
students. 



The eight categories clearly interlock to some de jree, since the 



dgjpisiort to vary instructional strategy in any one categc 
materials) often implies variations'in other categbries 
physical setting or student behaviors). The categories 
attempt to, list the different variables involved in instruction cov^ittng 



ry (e. g. , 
s Well (e. g. , 
epresent an , 
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what the student is doing, why and where he is doing it, with whom and 
with what materials, at what rate aind in what sequence, and what 
teacher behaviors are involved. At must be kept in mind, however, that 
in order for any of the eight above characteristics of instruction to meet 
the essential criterion of individualized instruction, the differential 
treatment that is prescribed yand implemented for an individual must 
be based upon a^diagnosis <m the student's own particular needs. 

TheseVariabies v/ere selected for study primarily because they 
reflect operational differences between classrooms, rather than differ- 
ences in the theoretic;al conceptions or educational assumptions under- 
lying a particular inslfructional approach. Classrooms can be meaning- 
fully compared with/resp6ct to each' of these characteristics, and taken 
together the cat^gori^s seen^ to 'encompass all the major ways in which 
instruction can b^ individualized at an operational level. 

An alternMive to the approach to the variable categorization 
taken here wovald be to Vonstruct^a similar list of variables which are ^ 
based on broad programmatic educational goals or different models of 
the learning process , (such as the **extent of student involvement and 
Sjelf-direcjtio^** or 'lamount of consolidation of learning provided*^, and 
attempt t^o d^eterrrmie which of these appears to be associated with better 
outcom64. However, it is our posittonjfhat such an approach would be - 
©riittl^ value because it is not associated with specific operational 
practyce^f. To/be of any fjractical ufee, the study must'be able to assoc- 
late ipecific yostructional practices with classroom outcomes, and thps 



za. 



we Jiawe .fociVsed our categorization of variables related to individual!- 

ibr// standardization around actual instructional, techniques. Once 

ve learned something about which practices are associated-with 

hiy6h out/cofnp.s, we will be in a much better position to examine the 
/ * ' 

imolicayiprTiS for educational theory, . 

/ ' * , ^ 

esides characterizing individualized instruction in terijis of 
arialfion in content,, rate,' sequence, etc, , also central to our concept 
/of inaivi^ualization is the extent to which instruction is individualized, 
i.e/,, the percentage of students who utilize different materials or 
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receive different teacher behavior etc, , as a function of individual 
diagnostic-based prescriptions. For example, the teacher may form 
small (theoretically homogeneous) instructional groups which in fact 
are prescribed different objectives. By our definition this teacher 
has individualized instruction more than a teacher who prescribes 
the same objectives for every student in the class. Therefore, indi- 
vidualized instruction can vary in the way it occurs and the extent to 
which it occurs. Becaus-e of these variations, we have concluded that 
individualized instruction is multi-dimensional irt nature. as illustrated 
in Table 1 below. ^ 



Table 1 

'The Multidimensional Nature of Individualized Instruction 



• 

f 

t 

— ) ' . 


Extent of Individualization/Standardization 


Extent to which Diagnosis, Prescription, and 
Implementation Occurs for: ' 


Individual Student ~ 
(Individualized) 


Subgroups , 
(Differentiated K 


^ Total Group 
(Standardized) 


1. Content 








2. Rate 








3, Sequence - 








4, Materials 








5. T&4cher 

Behavior 
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^-6. Student 

Behavior 
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7. Social V 
Setting' 
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8. Physical 
Setting 
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The degree to which these eight dimensions of individualized 
instructions occur independently of one another 'is an empirical ques- 
tion that 'should be investigated in the proposed research. Further, 
the nature of the inter relationsHip a'mong these dimeyisions may help 
define qualitatively different kinds of individualized instructional 
programs. For example, in som4 kinds of individualized instruc- 
tional programs, there maybe a high degree of* individualization in 
terms of rate and materials, while in other kinds (such a5 might be 
found in alternative schools), greater individualization in content and 
sequence might be expected. ' , 

The eight dimensions of individualized instruction are disccussed- 
in more detail in a later section and are hereafter referred to as the 
"key" process variables that distinguish individualized arid standardized 
instruction. > 

2. Towards Defining Standardized Instructions 

/ * In contrast to individualized instruction, standardized in- 

struction involves assigning essentially the same ^educational cur- 
riculum to. all students in a given group. This assignment mjay involve 
a prior step of diagnosis of individual needs, but is distinguished from 
individualized instruction in that th^ prescribed curricvilum and imple- 
mented instructional programs are based on what would be best for the 
majority of students in a classroom rather than for sub-groups or in- 
dividUctls . 

In actual practice, the distinction between individualized and 
standardized instructional approaches will be largely a matte^r of the 
extent to whith individualization is occurring along a;nV of the eight " 
dimensions. The greater the number of students in a given classroom 
who are treated differently becaus e.they have been found to have 
different characteristics.and needs, the more the instructional program 
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can be^said to individuali zed, ' in a completely standardized program^ 
hov/e^r, every student is treated alike. 



\ 



B. CONCEPTUAL MODEL FOR THE STUD^' DESIGN 

4. ^ 



/ 1' Indiv\^^lization of instruction does not occur in a vacuum. /I^th 
' ' ' ' j^' 

the fo rm that individualized or standardized instruc4^04P)-take wii^nn a. 



classroom and the impact on outcornjs are likely to be affec^Q by a 



■^AVide range of other variables. * * 

In addition to the key distingui^M«g p r oc e a^ vaxiap'^s , other 
Variables have been included blfecause they meet one ^^ore of the 
* following criteria: 




A* 



variables that are likely to have a* dir^jpt- impact on outcome 
ahy progra'm whether in^^^S/idualized or standard- 



measures m 
ized. 



variables 'that potentially affect the i^ay in which ! 
individualized or standardized programs are 
implemeilted. 

variables that are lijkely to moderate the effectiveness 

of various types of individualized or standardized programs 

4r- 



In the following sections, using four set^ cjf variables to organize 
the discussion, we will present our conceptual scheme by identifying 
the con^onent variables, pointing toward their operational definition,* 
.^and justifying their inclusion in the scheme. 



The first set are process variables whylch pertain to *4n-class" 
phenomena. This includes all those variables describing the way in 



which instruction is actually carried out. 



1. 



It' should be noted ^thkLltJ^s least lag-iGally possible t hat i ndividual 
diagnosis might lead to the. conclustion that all students iri a given 
classroom have the same' needs, in which case a standatrdized pro- 
gram might be indicated evenly ^'individualized** criteria. While 
it is obvious that some classrooms are more heterogenous than 
others. It is CRI's posit ion t hat in^pxSi^tice no classroom is horhto- 
geneous. , \ ^ \ - . 
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. Two categories of process variables need to be distinguished for 
purposes pf this research. The first kind consists of the factors which 
differentiate individualized Yrom standardized instru6tion. These are 
of central interest to the study and have been outlined previously. The 
secon<J category includes all classroom process variables that do not 
^themselves distinguish between these .two types of instruction, but which 
'are important aspects of the instructional process in other ways and 
which therefore need to be assessed. These would include, for example, 
the number of hours per week devoted to math and reading instruction, 
the use of different kinds of positive and negative reinforcements tech- 
niques* and the type of instructional materials available for use and 
actually used in the classroom. 

*Jwo other sets of va3:iables share the property of being '*givens/' 
They aye contextual variables thought of as Constraints imposed by eitherj 
extra-class, school, or commiinity characteristics, and input variables , 
which are primarily individual student or teacher attributes. . 

More specifically, contextual variables refer to those charac- 
teristics or dimensions which can be used to describe the instructional 
setting at a leVel broader than the individual classroom. Major contextual 
'Variables include geographical region, urban-rural characteristics, 
commiinity characteristics of students and staff *in the school as a 
whole. More interesting contextual variables might include such things 
as the interpersonal climate in the school, level of parent involvement, 
the nature of informal lines of commtmication, and the degree of 
district, school andHfeacher control over program selection. ' 

4 

Input variables refer to those characteristic featur-es of the 
classroom itself which ffiight Ve expected to relate to the success or 
failure of the prograrn, and'which should be[included in the analyses as 
covariation faotofs. The major input variables include the character- 
istics of the students in the class (e.g. class size, initial achievement 
scores, mixture of disadvantaged vs. non-disadvantaged students, 
initial non-cognitive scores, etc. ); those of the teachers and other 
instructional staff (e. g. staff size, teaching experience, instructional 
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assignments and roles, presence of specialized skills, initial attitudes); 
and the cjiaracteristics of the classroom program and facilities (e, g. . 
instructional grouping patterns, traditional vs. open or non-graded 
classroom, physical facilities ). , ^^''"'N^ • ' . * * 

The fourth set' of variables in the conceptual mOdeJ are outcome 
variables . Xhe most obvious outcome variables the research team 
should look at are student^s achievement in mathematics and reading. 
Less obvious, but possibly of equal significance are classroom .environ- 
ment or non-cognitive dependent variables . Programs will certainly 
have consequences on student and teacher attitudes as well as direct 
academic consequences. Programs which effect how stude;nts and 
teachers feel about tliemselves, each other and the learning process 
could even be more important than initial specific content learnings, v 
For example, if a student as a result of being able to achieve at his 
own rate, learns t.o like learning, that might be more valuable in the 
l6ng run than how well he initially learns to read. 

Exhibit 11- 1 presents ap abbreviated vis vial s ketch jof the propose^ 
conceptxial model indicating the interaction between these four sets of 
variables. .As Exhibit II-l illustrates, input and context variables are 
expected to have direct effects on in-class process variables which in 
turn effect outcome variables. In addition, Wocess variables will have ] 
effects on each other. Finally ,j although it iA beyond the scope of th^e 
specific proposed research, outcomes will (hopefully) in turn have 
effects on input, context and-process variable^- 

The primary concern of this research is the effect of individualized 
V€^^rsu5 standardized compensatory inst:ructi<in on outcomes, i.e., 

^ement in math, reading and other non-cognitive factors or class - 
envirpnment. In order to make intelligent statements about this 
primary concern, the research effbrt should specify under what set of 
Circumstances individualization- outcome rejationship o*ccur. ]prot)ably, 
individualization is likely to .be more successful in certain contexts or 
communities and less' successful in others. Likewise, inputs,^ i. e. , 
student and teacher attitudes, prior experiences, abilities and interests. 
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'^KI have^major effects on .the nature of iridividuaiiiation and 

.'t resultant outcomes. ^ " 



..I. 



'in summary, CRI's overall conceptual approach to the study de 
i I sigh^differs in a number of respects from that suggested by NIE in the 



Request for Proposal. The reason for these differences is that after 
\ |.| considering the nature of the problem, we do not feel that individual- 
' ized instruction can be assumed to differ from standardized instruction 
y ih any single, well-defined respect. The*two approaches at the conc^p- 
;f' ■%na.l level seem to represent two reasonably distinct instructional 
■ji strategies, but ones which are characterized at the operational level by 

highly complex clusters of interrelated practices, the particular com- 
'J bination of which vary widely from one program to another. Thus it 
IS considerably easier to distinguish the two ajiproaches" at a broad • 
conceptual level rather than at the operational level in the classrq6m. 
(,i methodological approach that we have developed will, however, 

allow thfe contractor to develop empirically derived operational defi- 
nitions o? individualized programs. • - 



V 
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III METHODOLOGY 

A. INTRODUCTION ^ 

The purpose of this chapter is<^ specify in some detail Jthe pro- 
cedures to be used in carrying out the study design. The following 
methodological issues will be considered: the relfeearch design and the 
researdh questions that the stiady should address; the nature of the 
sample and procedures for obtaining it; operationalization and measure- 
ment of all stu4y variables; and the development of specific plans for 
^data collection and data analysis. 

Since the choices and r ecomjnendations CRI h^s rnade with 
r.espect to each of these methodological issues are based on our'^ 
^ analysis of the best overall strategy to take in designing the study, 
we shall attempt wherever appropriate to document the criteria^that 
have been used in makiAg a partictalar decision. While this will be ^ 
done specifically in each^pf the sections that follow, it may be useful 
to begin with a brief discussion and review of the considerations 
involved in developing the overall design. . ^ , ' 

The rnajor criterion in developing the methodology is that the 
initial stages of the research be consistent with the definition of 
J individualization/standardization as a, mUlti-dimensional concept. 
/ Later stages, of the research, hpwever, should be directed '^t deter- 
^ rriining on an empirical basis whetjher it makes sense to talk about 
ihdividualizatipn as a single treatment dimension;. and if not, what 
naturally occurring treatments related to individualization can be 
identified? The next*step of the research strategy wou^d be to 
' examine the effects of these tfea4:ments on outcome variable^. 

The "program free" orientation CRI has taken in.designing the 
study has several implicatioiis for the types of measures, procedures, 
and analyses that will be used. For example, the instrument employed 
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to assess student achievement can focused on general ejiucational 
goals rather t^n on the particular objectives *of the various programs 
being compared,^ i. e,,*this approach avoidJB to some ex^t the prob- 
lems that are inherent in trying to make comparisons between program^ 
which may have somewhat different objectives. ' 

Another implication is ^hat the classroom rather than the school 
or '^educational program" should become the sampling unit. Thus, 
each unit can be described in terms of the degree to which it does or 
does not ^xhibit J'individualization" pf instruction. By taking tiiis 
approach, the focus attention is on those underlying variables that 
truly distinguish individualized from standardized instruction rather • 
than on idiosyncraJ:ic program characteristics that are tied to given 
sets of instructional materials which are likely to be changed by the 
N:ime the study' is completed. " 

' Our basic aj^proach then is to obtain a sample of classrooms ^ 
that appear to vary greatly along the eight dimensions of individuali-, 
zation /standardization, measure through a series of ins truments .the 
extent to which the classrooms actually do vary, and then contrast 
the outcomes of programs which appear to cluster around certain under- 
lying process, input and contextual variables. 

RESEARCH DESIGN'' 

The study involves a quasi-experimental, longitudinal design, 
with pre and post measures of student achievement. and teacher and 

* 

student attitudes. Treatment groups are defined by categorizing 
existing classroom progirams into two of more gf'S'ups on the ba^is 
of their patterns of individualization or standardization of classroom • 
instruction on each of several dimensions. In addition, the design 
provides for two observations of classroom processes, separated by 
a" period of t^o. months^. The design can be schematized as^oUows: » 
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^.X^ through refer to different treatpnent groyps: 0^ and 0^ 

are observations of student achievement and non- cognitive, attitudinal , 
measures," and 0^ and 0^ are. observations of classroom processes,. 

The primary focus of the study is on deterrnining^whether the 

treatments (i. e. , differences in-individualization of instruction) have 

any differential effect on outcome measures (i. e. , changes from Oj^ 

to 0, in student achievement and other n>easures).- 
, 4 

Th^ variables in the study have been divided into the following cate- 
gories: dimensions oMndividualization, other process variables, outcomes 
variables, input variables and contextual variables* Input, contextual 
and other process variables have been included for two reasons. 
The first is 'to **Control'^ for possible confounding^offt'Ke^variable of 
primary interest with other variablft<=i. If, for example, it happens 
that classrooms with individualized instruction tend to have k greater 
number pf teaching aides than do classrooms with standardized 
instruction, it is necessary to take this into account in comparing the* 
two types of programs. Second, it is important to be able to assess 
the extent to which the effects of individualization might interact with 
other contextual or backgroCind variables. Standardized instruction 
may be more effective in some settings, individualized in others. 
Since the resultp are to be used to help make important policy 
recommendations, it is essential that the analysis enable us to make 
statements about the likely effects, of a given program not only in the ^ 
abstract^ but in the particular types of settings in which it might be 
implemented. 
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C. . RESEARCH QUESTIONS * ' - c 

The overall research strategy can be'divided into three stages, 

each of which can be described by a set of research questions. 

1. Stage 1 - Defining Treatments 
• - ' 

In the first stage, the study should focus on describing 
the types of compensatory education programs which currently exist 
in terAisrof input, context and process variables. The foUowihg 
research questions should be addressed: 

• What patterns of variation exist between programs 
with respect to variables related to the concept 
of individxialization? 

• I s it possibler to define a single meaningful dimen- 
sion corresponding to the notion of individualization? 

« 

• Is it possible to define"^' typology of programs with a 
few categories into which' most existing programs " 
can be classified?^^ 

2. Stage 2 - -Comparinfi Treatment Effects 

Data from the first phase would be used to divide programs 
into categories, on the basis of naturally occurring clusters of pro- 
gram types. In the second stage, the task would be to assess the 
effe'^^-s of the treatments defined in the fir^t stage on student achieve- 
ment and classroom environment measures. This would include 
addressing the following research questions: 

• Which program types seem to produce* the largest 
gains or growth rates in student achievement? 

• Which types of programs produce the largest '^gains'' 
or positive changes in attitudes and self-concept? ' 

IL,^ Are these ef/ects present even when the effects of 

possible confounding variables are taken into account? 
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3. Stage 3 - Predicting Implementation Effects 

In the third stage, we would attempt to predict the likely 
effects of the program '*tr eatments** if they were-implemented in 
classroorfis having specified characteristics. The goal would be to 
develop a model of the likely impact of changing from one type of 
curriculum to another* If the treatments' haVe consistent effects - 
across classrooms, this task is a rather straightforward extension 
of stage 2. However, it would go beyond, stage 2 in that interaction 
effects would be taken into account as welL Specific research ques- 
tions include the following: , 

♦ 

• Do'the different ^'treatments" or program types 
actually occur in a wide variety of settings? If 
ther^ is a particular type of setting (as defined 
by contextual and input variables) in which a - 
given program type does not'occur, is this because 
of any fundamental incompatibility between the 
two? (The first is an important 'empiriqal 
question, the second an important 'analytic one). 

• Are there^contextual and/or input variables that 
6erve to limit or to enhance the effects of a given 
program? Are^the^e "cross-over" interactions 
such that a program which is superior in one 

setting is inferior in another? ^ 

• For a given set of c^gt^u^lior input character- 
istics, v/h^t is the-likely impact of a particular 
type of program when implemented in a classroom 
having those characteristics? 

Each of the above sets of research questions can in turn be con- 
.cretized into a large number of more specific qud'stions,^ by framing 
it in terms of specific variables rather than, categories of variables^ 
Jn the sections which follow, we shall attempt to outline in more, 
detail the procedures developed to carry out the research design and 
* answer the general research questions set forth above. 
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SAMPLING PLAN 



In developing a sampling plfen, we have 'been guided by *(l).a.^t 
of general considerations 'which reflect the goals of the overall study 
design and (2) specific constraints irnposed by otjier. features in the 
design and secpndary policy ^oals stated by NIE in tlie Request for 
P.roposal. ' , • .... 



i. 



General Considerations 



For the- reason's stated in Chapter I, ORI does not deem 
it advisable to seek" a sample of programs which are categorized as ' 
individualized or standardized op the basis pf orlly one arbitrarily 
chosen criterion (such as the presence or afcs'ence of variation in 
rate of stuident progress). Rather, the goal should be to identify a . 
•sample of programs ^^Kich represent a wide range of variation along 
each of several different dimensions of individualization vs. standar- 
dization, ^ V f 



Practically, this would involve a sequence of steps. First, a ' 
sample of^ districts would be selected on the basis of existing survey 

ata. * The second step would involve selection of schools within each ^ 
d^trict tnat appear to represent a reasonable degree of variation in 
theiKoverall degree of individualization or standardization. The 
t^ird step would involve gathering more specific information by 
telephon^\on the classrooms and programs within, these schools, 
and the fourth step would involve using this information ta select 

a final sample^f clasiS rooms, . , 

I \ ' . 

Sijhce it is ir^t the purpose of the study to obtain an accurate 

estimate of the frequency with which different types of programs ar 

actually being used, thrs should not be a major consideration in. 

selecting the ^nal sample. \ Certain types of programs (e.g.", s 

dardized programs) may weir be iinderrepresented in 'the final srampl.e 

with respect to their actual freqii^ncy of occurrence, a nX others majj 

be oyerrepresented. The goal shouldbe to accurately refUctthe/' 

range pf varia^tidh, rather; thafiHhe frequenby^f program types./ 
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2. Additional Constraints Set by Policy 

Three additional constraints on the sample are imposed 
by secondary policy considerations set forth by NIE in the Request 
-for Proposal. • * 

a. Compatibility -with District Survey I ^ 

NIE would like to c'ross- validate program descfTp- 
tiort obtained in District Survey IVith measures of actual implemen- 
tation obtained in this study. 'Therefore, one of the sampling con- 
straints IS that half of the total sample should be .obtained from District 
Survey I. CRI suggests tha;t the other half of the sample should be 
obtained from the sampling frame developed for District Surve^^I, 
following the same stratification criteria. Thus, in the fi^st pf the' 
four steps outlined above, the contractor would begin wi4:H the 102 
districts represented in District Survey I and add 102 districts selected 
according to the same criteria as used for District Survey I, for a 
total of 204 districts. In §ach of the remaining steps toward select- 
ing^ a final sample, the contractor would impose the constraint that 
l>alf of the schools, and later half of the programs selected, would 
be represented in District Survey I.^ 

b. Instructional Setting 3 * 

One pf the major issues surrounding the use of corxi- 
pen^satory education funds is whether compensatory education programs 
should be implemented within a regular classroom or outside di it. 
At present, many schools provide separate instruction for students 
in compensatory orograms.' By providing separate instruction, there 
Is some insurance that the funds ate b.enefiting the students for whom 
they are*intended rather th^n befing tfsed to improve instruction in 
general; however, there are questions about whether it is always 
wise to pull disadvantaged students oi.t of a regular classroom for 
special instruction. 

"I 

In order to gather data relevant t6 this policy question, NIE ^ 
would like to include in the sample schools of both types, in suffi- 
cient numbers to make a meaningful comparison. 
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To meet this secondary policy objective, an additional constraint 
needs to be imposed on the sample. Approximately 50% of the schools 
in||luded in ^he sample should provide compensatory programs outside 
of the*/egular classroom, and approximately 50% within it. However, 
wherfever reading and/or math instruction is provided both inside and 
outside the classroom, the ''outside the classroom'' setting should be » 
considered an extension of the regular classroom. "'Ther*efore, these * 
instances should be tfjeat(^d as a part of--the "n9n-puli outy sampU. • 
CRI recommends that data„ relevant to this criteripn should be gather- 
ed in the telephone screening procedui^e. Every attempt should be 
madp to ensure that in the sample as a whole, this "instructional 
setting" variable is not confounded with the extent or type of individ- 
ualization provided in the program. 

c' ' Avoidance of "Idio^syncratic" Programs 

NIE has stated that it wishes to exclude from the samnl 
tho^e .programs which are unique or highly idiosyncratic. Since the 
long-range purpose of the study isrt.o make recomm^'endations to 
Congress in the form of objectives |^hich can be implemented on a large 
scale, the policy reasons for-this are obvious. 



However, NIE has operationalized this criterion by stating that 

pfrograms chosen should be represented in at least t^o districts or 

100 classrooms. This operktionalization poses some difficulty within 

our framework, since we have recommended that the study proceed 

under the assumption that all programs are different until proven similar 
« 

Moreover, it is* our belief that the sample should not be 
restricted to programs which areppresently in widespread use. No 
attempt should be made to eliminlTe programs which represent, for- 
examjRie, a unique or idiosyncratic use of imagination and insight. 
The only valid policy reason for eliminating idiosyncratic programs, CRI 
believes, would be if they are successful by virtue of a. set of physical 
or financial resources not generally available, or by virtue of a set of 
instructional practices which cannot be implernented elsewhe're. 
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To help ensure that the programs chosen could for the most 

part be implemented elsewhere CRI recommends that the sample be 

. restricted to public schools. Since there is a good deal of variation 

even among public schools in the amount of resources available and 

the political climate surrounding educational practices, thig does not 

completely solve the problem. But it does help to solve it, since it is 

not unreasonable to maintain that any program which is currently ' 

^, . being implemented in a public school can at leg^st to some degree be 

implemented in others as well. ^ 
/ 

3. Determination of Sample Size 

: » 

i 

CRI believes that the study should involve a detailed, in- 
depth and extended examination of a relatively small set of schools 
rather than a more superficial examination of a much larger set. 
We are, therefore, recommending that the study design include extended 
classroom 6bservation, structure^ interviews with teachers, and other 
data collection techniques which are relatively expensive and time 
consuming. > • , 

As a practical manner, then, the sample size has been set with . 
this consideration in mind. We have set a target size of 250 class- 
rooms for a complete set of data. ^ 

4. Selection of Grade Level 

The policy questions underlying this research are rele- 
vant to grades K through 4. However, to sample all five grade levels , 
would present enormous practical difficulties. Indeed, these diffi- 
\^ culties do n^t disappear entirely unless the study is restricted |o one 
."^'^ grade level, and CRI recommend-s that this be done. This restriction 
^ enormously simplifies the problems of data collection, selection of 
tests, and interpretation of the results of the study, and allows the , 
contractor to concentrate resources on ensuring the internal assess- 
ment' of the generalizability of the results across different grade 
levels. It is our feeling that in a study primarily focused on the 
processes rather than the .content of instruction, this limitation can 
be lived with. , . 

f ni-9 , - ' ' ^ 



CRI re commends that the study should focus on Grade 3. This • 
"recommendation is based on two considerations.*^ First, our discus- 
sions with school personneLand educators suggested that in the grades^ 
K and 1, and possiblyj 2 as well, individualization o£ instruction whethe 
planned or intentional is so widespread that it is djfficult to find class- 
rooms in which instruction can be said to /'standardized, " at least in . 
terms of actual classroom practice in reading instruction. 

— Second, it is much rrtore feasible to obtain reliable outcome 

measures in the later , gra^des. This is particularly tfue for student 
self- report attitudes, which are relatively more difficult to measure 
reliably in early prima ry grad es, but i t may also be true of achieve- 
ment tests, because it: is easier to pick up short-term -gains after 
students have learned onset skills. 

5.. ' Classroom as the Sampling Unit 

CRI reconfimends th'at the classroom be used as thejjrimar-y 
sampling unit. ''Classroom'* is defined as the setting' in which compen- 
satory education students receive €heir math and reading instruction. 
Therefore, "program" is defined as the reading and rriath instructional 
processes and content utilized within a given classroom. In practice^ 
th is m eans that whether compensatory education students receive 
their reading and math instruction in a "regular" classroom or in'a 
separate lab setting, that setting should be treated as the sampling • 
unit. However, in instances where compensatory education students 
receive instruction in both the "regular'* class room 'and in another 
setting (e. g. , lab), their participation outside of the classroom should 
be considered an ex tension of th e c j^assroom and not as a separate 
sampling unit. Data, however, should be collected on the educational 
experience of compensatory education students in all settings if\ which 
they receive reading and math instruction; however, for analysis 
purposes, the contractor should be able to distinguish the differences 
in settings. * . • ' 
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Data should be collected on all students in the claasroona, wheth 
disadvantaged or not. However, the contractor should be able to 
clearly identify the compensa^bry education student sub-group in ectch 
classroom, and run. separate and parallel data analyses on. this group. 
In practice this may frequent]hy pose some difficulties. While in many 
classrooms the teacher will be able to provide the names of compen- 
satory educatipn students, or they will be identifiable by virtue of the 
« ■ _ 

nature of the program, in other classrooms this will not be the case. 
When it is ""ngt. possible to itfentify such students on the basis of 
information provicJed.by local school personnel, it is recommended 
that pre^est'achie^errt'ent Sto'res be^us-ed for this purpose, using a 
criteriqn of Ql or Q2 sco/es in the total math or total reading score's. 

^ For purposes*b( data analysis, it will often be possible to 
examilie the data withi)i classrooms as well as between. Thus data ' 
files should be kept dn Individual students. ^ 

6. Procedure for' Qbtaimng tHe Sample 

< ^ It. is recommended that the Sampling strategy proceed 
sequentially from selection of districts to selection of schools to 
selection of classrooms . 

a. Selection of Districts / 

The goal in the first stage should be to obtain a 
nationwide sample of districts representing a variety of geographic , 
regions,^ district populations, socioeconomic levels, and other 
characteristics. It is not the purpose of this study to offer a truly 
representative sample of schools or districts. However, it is highly 
unlikely that a sarnple restricted to narrow geographic regions will 
adequately represent other bacjcground and contextual factory in 
sufficient variety. We have found that States differ considerably ilJ,^ , 
the ways in which they enco^irj|t^..^r require their^d^fil^rict$,jtp utilize 
Title I f unds. Many of thej^.e 'diffeivetices rnay have an important 
bearing on how the progratfes are carried out. 



In addition, geographic differences in and of theVnselves are 
yery likely , to emerge ajs important determinants of the impact of 
the programs. • Since the policy recommendations based on the 
study will be applied on a nationwide scale"^) ^it is important to 
have sufficient information to take these differences into account. 
For these reasons, Sve feel that wide geographic diversity in the 
'.samite is essential. 

^ ■ ■ 

" Moreover, the .contractor should select half of the sample of 
districts from District Survey I. It is therefore recomrhended that 
the contractor use the sampling frame developed for District Survey 
I to select 102 districts, stratified according to the same variables 
used in that survey. * These 102 districts would be added to the 102 
selected for inclusion in District Survey I for a total- sampling of :| 
204 districts f*epres"enting different district sizes, geographic re- ' 
gions, and levels and combinations of Federal and State funding for 
compensatory education. 

^ b. Selection of Schools 



' In the second sta^e, th^ contractor should send 
letters to the superintendents of the 204 districts, describing the 
study and soliciting recommendations of four principals of schools 
within each district receiving compensatory funds. Two principals 
shbuld be likely to have an '^individualized, " and two should be likely 
to'have a "standardized** third'grade classroom within their school. 
These letters should be sent on or about March 1^ 1976, and should 
be followed up by letter or phone if ther^e is no response within two 
. to three weeks. 

This procedure w^iiM^yi^ld a list of approximately 8004dbSS|s, 
with some initial likelij^od thai both individualize4-<ind standardized 
classrooms' might be fpu'ftdtn these schools. (It should be emphasized 
that we do not expect that superintendents will always have accurate 
information regarding the individualization of classrooms in their 
schools, and that the purpose of requesting thi's information is to help 
locate classrooms, not to categorize them conclusively). 
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A possible variation of this procedure shoxild. also be given con- 
sideration. It.might be considered desirable to weight the niimber of 
schools selected according to the size of the district, with super iji- / 
tendents of^ large districts being asked to identify a larger number of 
schools than superintendents of smalle4 districts.. To'.a large extent, 
this IS a mattept^of policy, anfd NIE shpxild providje guidance to thV 
contractor in determining to. what extent the Sample should be 
^r*epresentativer of the districts receiving Title I funds, or the sclit)t>l:s • 
receiving suchfvmds^ or a cbiribination. In tna king this determination, 
it should be kept in mind tjiat the District Survey I sample already 
has overrepresented large districts in proportion to their total number 
although probably not in proportion to their share of the total student 
population. * ' 

c. Sele^ction of Cla^s roomer - ' < 

On March 29, 1976, the Contractor should send 
letters to the principals identified in the preceding stage, asking 
them to identify a third grade classroom which might be appropriate 
for inclusion in the study, and to provide as much preliminary infor- 
mation on the nature of the program as they are able to give. 

On the basis of this information, the contractor should narrow - 
the list of schools /programs to 400 which seem to represent a good 
initial mix of individualized/standardized classrooms within each of 
the levels of variables which stratify districts. 

The contractor should then begin a screen by means of a tele- 
phone screening procedure of the 400 teachers identified by princi- 
pals as responsible for running the classrooms. The telephone 
screening should focus on the nature of diagnosis, prescription and 
implerri^entation utilised in the classroom, and its goal should be to 
provide a basis for preliminary categorization of each program as 
''individualized*' or ''standardized** .with respect to each of the eight 
dimensions described earlier (or something very much like them). 
Additional information should be obtained at this stage on^tW ' 
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"instructional setting'* variably, siz^ 6f the classroom, number* 
and proportion of disadvantaged students, and a^y other" variables 
which vj^i^ll be consixdfered in determining the final sample. 

It is suggested that this screening be conducted between May 
3 and June 4, ^1976. Upon completion of the teacher sci^eening, the 
contractor should have enough data to construct a matrix consisting 

of a list of schools contacted, crossed with indTvl^ualization/stan- 

t ]' 

dardization variables. The next step would involve using the infor- 
mation contained in this matrix to select affinal sample of 25 0 
classrooms. The contractor should make use of systematic data 
analysis fo,aid in selection of the final sample; for example, use 
of such techniques as multidimensional scaling^to help identify 
naturally occurring clusters of program types from which class- 
rooms can be selected. Such techniques will also help to document 
the procedure used in selection. This task should be completed by 
• June 25, 1976. 

i 

. ^ The criterion for selection would be to represent a broad 
range of types of programs. Some programs would undoubtedly 
be "individualized'* with respect to all the variables; others .would 
be ''standardized" with respect to all of them. We suspect, how- 
ever, that a substantial number would represent a mixture of 
individualization on some variables and standardization on others. 
These latter should be included in the final sample in sufficient 
numbers to accurately rleflect the range of variation found in the 
initial sample. There should be an attempt to include programs 
representing ;iot only different overall degrees qf individualization 
as reflected in the number of "individualized" variables, but also 
different patterns and combinations of individualization, to the 
extent that these are found to^occur. 

7« Feasibility of /the Sampling Procedure 



The major ^actical difficulties *that may be encountered 
-in implementing the s ampling plan outlined above ar^e (1) obtaining 
a qualitatively and quantitatively adequate response from superinten- 
dents and principals and (2) obtaining accurate and useful information 
from teachers over the telephone* 
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With respect to the first problem, difficulties nj^ty be of twd 

kinds. First, there may be a low response* rate« This problerh ' 

can be minimized by allowing in advance for sufficient manpower 

and funding to provide adequate foUowup. Second, superintendents 

as a whole may be .unable to steer the contractor toward a sufficienlT, 

number of schools which^.are likely to provide individualized instruc- 

tion. If this^ seems' to be th^ case, then it is suggested that the 

number of schools'and' teachers contacted at the next^^tage^be ^djus- 

^' ieci ti^ward,'nfo'€nsure'tfiat a^ufficient variety of program types will 

be available for the final sample. 

* ' * * • 

* With respect to the second, problem, CRI has recently concluded 
a pilot telephone screening of teachers, and has concluded that the 
procedure is entirely feasible. Using an eatlier draft version of 
the Telephone Screening Guide (see Appendix\A), CRI talked with 
40 teachers and one principal in schools located in 26 states (see 
Appendix I for listings) after making approximately 75 initial inquir 

ries to school principals. * ^ 

^ ' • .... 

' ' } ' ' 

Descriptive data on each af the 41 classrooms is presented in 

y ^ . 2 ' ^ ^^'^^T ~ 

Exhibit m- 1.1 Fo cusing on the data relevant to ^ix dimensions of r 
in<iividualization- standardization several observations can pe m^de. 



The principal reported on the instructional practices of one of his 
third grade teachers who was unavailable because of the existence 
of a teachers' strike. 

The two other dimensions of individualization/standardiza|:ion of 
instruction- -social setting and pupil behavior- -were not measuRred 
because the decision to include these variables was not fina'lized 
until near the completion of the telephone screenihg.> 

3 • ' • ■ ' , - ■ "■ -A - " 

The data /from the telephone conversations were summarized ^in the 
following manner. A classroom was considered to be individualized 
alo.ng one of the dimensions if most or all students differed with i*e- 
spect to^lhe prescription along the dimension (e. g.., proceeded at 
different rates or ujsed different materials when working on given 
objectives and the teacher reported that such decisions weTe based 
on the diagnosis of student ability^ needs and/or student choice. A 
classroom was considered to 'be standardized along one of the dimen- 
sions if most .or all received the same prescription with respect to * 
this- dimension apd either no individu*5al diagnosis occurred or the 
diagnosis ^NiCras used as part of a diagnosis of the entire class group. 
A clLssroom was considered differentiated if the major differences 
in prescription for students with respect to the dimension occurred 
among different instructional groups, with most students within ar 
g-roup receiving the sartie prescription, and with diagno3tic activities, 
if present, ^being used to divide studenfcs into instructional groups. .^^ 
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* SyiTibols for math and reading are distinguished through separation >vith a 
'•sl^sh** (e. g. , Math/Reading) if math and reading instruction dp exhibit 
thesame extent of individualization-standardization. Otherwise*, one 
J^"*, 8yT|ibol, eifch'er "I", ^*S»S or *'b" is indicated for both math and^xeading. * 

f I - Individualized (diagnosis, pjeacriptioh, and implementation fo- 

cuses^n individual). 

' S - Standardized (diagnosis, prescription and"^ implementation focusea 

on entire class). - 
\ *' V . * . , . 

D - Differentiated (practice representing fniddle point on individual- 
izing -stafidardi2;ing dimension,' i. c. , diagnosis, , 
O • . * prescription and implementation focuses on sub> 

ERJC ^ groups of class). 
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First, three class roo.m teachers appear to be individualizing along each 
of the dimensions with respect to both niath and reading* inst'ruc'tion. 
gecond, no teacher seems to standardize instruction along all dimensions 
for both math and reading, giving tentative support to our previously 
stated contention that all teachers attempt to 'individualize.^' dii some 
manner. Third, six teachers report instructional practices that fall 
bet^veen individualization and standardization (i. e. , (differentiation) along 
all dimensions for both math and reading. Fourth, most teachers seem 
to employ some combinatiori of.indi vidualizing, differentating, and 
standardizing instructional practices, perhap^s individualizing along one* 
dimension and standardizing alang others. Other teachers are consistent 
in their extent of indi vidualizing-standardizing along the six dimensions 
for math, but employ instructional practices which are more or less . 
individualizing for reading'. ^ 

Tliere are several conclusions that can be- reached. First, infor-^ 
mation regarding the extent of individualization- standardization along 
several dimensions can 'be obtained from teachers via the telephone. 
Second, classrooms do differ with regard to the extent of individ- 
ualization- standardization along each of our six (and presumably eight) * 

dimensions, indicartitrg th^e^iitxtitr^ 

r 

of instruction as being multi-dimensional and the feasibility of con- 
structing a sample containing cUssrooms that nianifest a^high degree 
*^f variation along the major independent variables in^fchei^study. 
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E. MEASUREMENT AND INSTRUMENTATION 

I.' Variables * * * ^ . , ^ * 

The conceptual model presented earlier in thiisx^port has 
provided the framework for focusing the study: on the variaijl^s that must 
be examined in order to answer the research questions that have been 

, posed. This focu^ is necessary because the vast array of variables that 
might be examined with respect to any educational issue make it neces- 
sary to delineate those which are rD09t important, /This section of the 
report is designed to provide, an orientation to the variables that CRI has ' 
selected to be studied. The variables have been categorized and will be 
presented as follows:^ process (individualization/standardization variables, 

^and other process variables^ outcome (achievement and non-cognitive), 
contextual and input* » 

a, Proces^s Variables 

= : > • 

' 0 ^ 

. ; Two genie types of process variables should be examined. 

The first type deals with the distinguisliing characteristics of individualized 
and standardized instruction in terms of the eight dimensions of 4ndividu- 
ali/.ation/standardization that were briefly presented earlier. The secdnd 
set of process variables are those that may differentially influence or 
mediate tHe nature and/or success of instruction across t^riability in 
individualization /standardi^.ation. 

(1) Individualization /Standardization Variab les 

. > * Individualization Astahdardization varikbleis are 

derived from the definitions of individualized and standardized instruction. 

Included are the processes of (1) diagnosing student needs, (2) prescribing 

' 

instructional treatments to meet those needs and (3) implementing fche ^ ' 
prescribed treatment, in terms of the eight dimensions of individualization/ 
Standardization. • ^ • - ' ^ ^ ^ 

As Ijriefly meritioned, earlier , CRI recognized that there are several' 
ways a teacher can diagnose student needs dnd prescribe instructional 
treatments to meet those needs. These processes can be conscious or 
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unconscious, informal or highly structured. The nunnber of variables 
and the quality and types of data that are taken into accpunt in^^jlpaking 
diagnpsis and prescription nnay vary considerably across programs. 
' There may also be variation in terms of the f/equency of, diagnosis an 
prescription. • ^ / ^ 

While these factors are undoubtedly^ irrjiportant as concomitant 
variables in the analysis, in our conceptual/scheme studying the dif- 
ferent' ways and rationales for diagnosing and prescribing .does not ' 
help in differentiating individualized instruction from standardized 
instruction. In our conceptual scheme the critical concept related 
to diagnoses and prescription is the extent to which they accur at 
the individual student level. That is, the extent t^ which the indi- 
vidual student rather than the whole class or some sub group is the 
object'of the diagnostic^bas^i^p^escription. * ' 

Individualization/ standardization will be studied in term« of 
eight dimensions., These dimensions incorporate the bksic ways in 
which instruction may vary. The extent to which any classroom is 
individualized/standardized can be described in terms of the answers 
to the followin,g questions: . ^ 

• Along what dimjension(s) is/are individualized /standard 
ized instruction occurring? 

• What is the extent of individualization/standardization 
♦ ^ along this/thfe'se dimension(s )? 

^ To what extent is this variation based on individual 

vs. group diagnostic -based prescriptions? 

^ In sum, classrooms can differ from each other in'terrns of 

• ^ . -t ♦ . ^ 

the extent of individualization/standardization'^long''any of eight 
dimensions. Additionally, classrooms can yary with respect to the 
number and type of dimensions which are either individualized or^ 
standardized. Hence, classrooms are not either *4ndividtialized'' 
or ^'standardized, but are individualized/standardized in various 
ways and to varying ext^\t^. . n ^ 
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eight dimensions and their associated variable are npw 
discussed in more detail: ' 



(a.) 



Lontent 



The^co^ttent dimei^sions of individualization/ 

standardization is the extent to whicn^di^erent students proceed 

through different objectives. When this diffeT^tial treatment is 

.based on individual, diagnostic-based pres^:ription, fhe-ireatment 

ft ' • 
indicate's a high degree of individualization. 



This dimension is included in several models of individualized 
instructional programs (e,, g. , Bishop, 1971; Carmichael and Marshall, 
1970; Wilhelm 1962). However, usually the emphasis has been on 
programs in the secp^idary schools, where students are often divided 
according to post-secondary school goals (e.g., vocational and science, 
social science, or humanities college preparation). We maintain^that 
-this dimension is relevant even in the early primary grades. Probably 
the most obvious way objectives vary among young students is that certain 
students proceed through additional or enrichment objectives in one 
'l^bject'^area; presumably, other* students receive enrichment in other 
subject areas. , * . 



(b) 



Rate 



The rate* dimension of individualization / 
standardi^iation can be thought of as the extent to which different students 
are expected to proceed through identical objectives in differervj^ lengths 
of time as a fiinction of indivi(^ual, diagnostic-based prescription. 

Allowing for -variation, in student's rate of achieving objectives is 
he way mo'st teachers have attempted to individualize instruction (Associ- 
ation for Supervision and Curriculum Development, 1964; Rothrock, 1970). 
It ialso characterizes the oldest, modern era attempts to individualize 
instruction, i.e., the Winnetka and^^llrtToh plans (Howes, ' 1 970a). Such 
efforts are based on the assumption students learn at different rates', 
basically as a £,uncti6n of their different aptitudes (see. Carroll, 
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Several autliors have also included some-form of the ratfe dimension in 
their model of individualization (e.g. , Carmichael and Marshall, 197X); 
Devkult and Kriewall, 1970; Gijalpon?,' 1970 and 1971; Gronlund, 1974; 
Howes, 1970a; Wilhelm, 19621. ^ 

(c) , Sequence ^ . 

' THe dimension of sequence is the extent 
to which different students proceed through a given set of objectives in 
different Sequences.. Ag^in, differential treatment related to sequence 
thart results from individual, diagnostic-baseci^ prescription indicates a 
high degree»of individualization. 

This dimension is not ve ry. prevalent it) the literature^ primarily 

jcause most writers ctssurpe that all in-^tructional programs exist within 

a context^wioere there is a mandatory, specified sequence of objective^. 

(The sequence is r^ml^ed mandatory because the sub-matter dictates 

such an order logically anaTc>5-..school officials prescribe a specific order 

for achieving objectives. ) HoweverT^^Te^-cQncur with Devault and Kriewall 

(1970) that one way to^indiyidualize instruction isto--vai;y the sequence of 

objectives that a student masters. We assume that same iitsTrtnc^tianal 

" ' ^^""■"^'^"^-^ 
programs incorporate this dimension, and, importantly, that altering the 

* , t • 

sequence of mastering objectives may facilitate the achievement of sopie 

• . * ? 

students". In othe;: words, we propose thaf what mighf be the logical orde»r 

objectives for mathematicians, for example^ fnay not be the most effective 

sequence of objectives in mathematics for certain students. (Variation 

in sequences of pursuing reading objectives probably is less heretical to 

reading speci^^lists than similar variations in m^th objectives are to 

many mathematicians. ) . , - 

t ° • -> (d)7 Materials 

• * ^ ' • ~' \ ' 

* * The dinriension of jnateirials is ^defined as 

the extent to which different instructionkl materials are utililized by 

different students who are working oft £he same objective. A high degree 

of variation of materials resulting from individual, diagnostic-based' ^ 
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prescription is the indicator of individualization along this dimen^ion^ 
This process is sometinnes facilitiated by guides that cr.oss reference 
•instructionalmaterials with respect to specific instructional objectives.* ~ 
Variation in nnaterials ca:n be achiev.ed by using different bcToks and * 
^* learning aides with different kinds of students in or^er to achieve the 

sanne instructional objectives. The full range of the types of instructional 
nnaterials should be considered including audio-visual materials, 
workbooks, resource nnaterials, progrannmed texts, hardware, etc. 

(e) Teacher Behavior 

. The dinnension of teacher behavior is the 

extent to which a teacher relates toone student in a different manner 
than he/she relates to some other student^^^^^ these students are working 
on the same objective. For example, a teacher may find that cer- 
tain students respond to lectured, presentations, tutoring;- etc.. In 
short, any different way a teacher behaves with respec^^to different 
: students can be considered as a potential technique for individualiz- 
ing instruction ^f the differential treatment is congruent with the 
^.dia|nosis and prescriptions. In order to eliminate as much overlap 
and confusion as possible between the teachtr behavior dimension 
and^ other dimensions, 'the teacher behaviors that are to be consid- 
ered under this category are: (1) makes oral presentation, (2) gi\ 
^demonstration, (3) facilitates "discussion, (4) tutors, and (5) is not 
actively involved with students. 



ives 



il) StuJent Behavior 



The student behavior dimension is th.e extent 
to which different students engag,e in different activities while pro- 
ceeding through identical objectives. A high degree of variation in' 
student behavior, resulting fron^. individual, diagTi6stic-based pre- 
scription is the indicator pf individualization along this dimension. 

Here the particular student behaviors that are of interest are: 
wliether the student is reading (silently or aloud), writing, .talking, 
listening, observing, And/pr manipulating some object other the 
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for purposes of reading and writing. In short, varying what the 
student does in the classroom is one ^eans for oising information 
about the student as an index of differential treatment. 

(g) Social Setting 

• • Th,e aocial setting dimension is the extent^'^ 

"to which different students who are working on the same objective 
are assigned to work with different members of the teaching staff 
or other students as a function of identified characteristics of *stu- 
dents and staff member s. The question here is'who works with 
whom given teacher diagnosis. and prescriptions. For instance, is 
Johnny assigned to work with another student because she/he has 
complimentary learning abilities, is Johnny assigned to a small 
group of culturally similar stiidents, does he work by himself, with 
a teacher's aid or does he work directly with the teacher'. 

In sum, variations in social settings must be gerrfiane to spe- 
cific characteristics of individual students and the students must . 
be working on the same objective in order for the social setting to 
be considered JLQjd-ividualized. Further, the va-riations must be overt 
and intentional. 

(h) Physical Setting 

Finally, it i^ entirely possible that some 
students work better in one type of physical setting whereas other 
students learn bejbfer in a different type of setting. Physical sret- 
tings can vary with respect to such macr^'^vcC-riables as whether 
instruction is provided indoors or outside. It can also vary with 
respect to changes, within the classroom s'ucn as whether the 
students work at.desks, on the floor, at tables, in carrels, or at 
a learning center. Perhaps the mosl important variation in physical • 
se^tting occurs when compensatory education students are physically 
removed from the classroom for reading and/or math instruction. 
This variation is important because a **pull out** program combines 
the use of a s<iparate physical setting with a social setting that is 
^comprised of all compensatory education 8tudejat.a>* — — 
* ' * 
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^ Therefore, "the physical setting dimension is the extei^jfc to 
which different students, who are working on identical objectives, 
are assigned to different physical settings. 'Again, this differen- 
tial must be based on the unique needs of individual students. in 
order for this variation in treatment to be considered as a means 
of individualizing instruction, s * 

(2) Other Process Variables 

^he second set of prpcess variables that should 
be measured are those that are likely to influence the outcomfe of any 
type of instruction, tc^ help describe the type of instruction being offered 
or to differentially af'fect the- individualization processes. The variables 
in this cluster include whether compensatory education students receive 
reading -and math instruction in their regular classroom^or in a special 
laboratory setting apart from their regular classmates; total amount of 
instructional time in reading, mathematics, and the areas related to 
reading and mathematics .(such as social studies and^ science); student- 
teacher-aide ratios; the number of different students ^ei^ by each teacher 
per day; the amount of time teachers are given for planning; the type of 
inservice. training given to teachers in order to help them triaximize the 
effectiveness of whatever program they are employing} the procedufes 
employed for monitoring student progress (such ^-S' by the use of periodic 
objectives based tests); the nature of student inyolvement in planning 
their own programs; the system of record keeping, ^he conteiit of records 
kept on each student and the frequency with which they are updated; the - 
degree of parent involvement; etc. 

Other process variables that appear to be'extremely fmpo^tant a^e 
related to teacher/student and student/student interactions within the 
classroom. Foriexample, the use of praise, punishment, feedback and 
other teacher behaviors may possibly be rponitoring behaviors that en- 
hance the success* in one type of program or another* Student/student 
interactions such as students talking to other students in class (related 
and non*- related to instruction) will alsd be ^assessed. The use of physical 
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environment of the classroom, in terms of its furniture, materials, etc. , 
may be important moderating variables. These types of variables are 
more completely discussed in a later section which discusses classroom . 
observation instruments. 

b'l Outcome Variables 

The selection and operationalization of relevant outcome 
variables is a critical feature of the study design. If the study is to provide 
a meaningful basis for comparing existing program dimensions for fc^e 
purpose of drawing polic'y implications, then the outcome variables must 
reflect important educational objectives applicable to a wide vafiety of 
programs. CRI feels that there are two ways that this can be accomplished 
First, in selecting' measures of academic impact, every attempt should be 
made to include tests which measure student achievements that consltitute 
central objectives in most or all reading or mathematics pyograms at 
grade level. They should insofar as possible favor no one set of curricula, 
instructional materials or methods over any other. 

Second, the outcome vaf-iables -should include non-cognitive di- 
mensions, such as student and teacher attitudes and classroom inter- 
action variables. These dimensions constitute important educational 
objectives in and of themselves, and'hcive the additional attractive proper- 
ty that they can be appropriately measured independently of the particulctr 
achievement objectives embodied in a program. 

As suggested, in the RFP, two types of outcomes are considered: 

• achievement in math and reading and 

• classroom en,vironment which CRI takes to mean non- 
cognitive outcomes 

The former is of central importance, especially given the thrust 
of compensatory education programs. However, v the importance of 'the 

Matter type of out;come, which we interpret very' broadly, is not to be 

• * * ' . * 
underestimated for three reasons. First, it is probable that the first 

years of schooling. not only begin the process of subject matter instruction 

but also are important in shaping children's attitudes towards themselves 




and toward the schooling process. Furthermore, the long term effects on 
subsequent achievement of these attitudes may be eqUally, if not more, 
potent than the long term effects of early subject matter learning. Thus, 
classroom environment or non-cognitive variables must be considered. 

*> . * * 

Second, it may be that certain patterns of individualized or stand^ird 

ized instructional programs produce" equal student achievement (in the 

sliort run) but have varied impacts on other attitudes and' behaviors of 

students and staff niembers. The inclusion of non-tfognitive outcome 

measures, then, provides a further basis for distinguishing the effects 

of different kinds of instructional programs. -It seems reasonable to 

suggest that educational decision-makers, when presented with a choice 

of implementing either of two^^^fst^uctional programs, each of which is_ 

purported to produce equal math and reading achievement in their type 

of school context,* would select the program that produced other types of - 

positive outcomes. Given that one of the purposes of the proposed study 

is to provide information for such choices, it is imperative that these 

other non-cognitive variables be incorporated.' 

Third, these extra -cognitive factors should be expected to have 
initial independent effects on compensatory programs. It is safe to 
assume that some attitudes students bring to class inhibit while others 
enhance learning. Further, some types of attitudes may foster some 
program processes, while inhibiting op having negligible effects on 
others. / • 

(1) Achievement 

( 

Personalistic impressions (for exagriple see 
Darrow and Howes, I960) usually have fayored some type of individual- 
ized instruction for enhancing of achievement outcomes. However, the 
reviews of available research on the effects of individualization in terms 
of nnath achi^evement (e.g., ^Weaver, 1966) and reading achievement 
(Groff, 1970; Seeber,. 1969) is r^pt as conclusive. First, some of the 
^udies ^did not support the superiority, finding no significant differen^ces 
or an indication that some QcTier method produced better results. * Second," 
even if the findings were more uniform, the findings would be far from 
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conclusive, because of inadequate research designs. Previous research 
is notably weak in sannpling and control procedures, and progrann de- 
scriptions have been so sketchy that it's impossible to tell whether or 
in what way "individualized" progranns varied. 

The nnajor issues concerning nnath and reading achievennent in- 
volve qjiestiohs of nneasurennent, Sonne of the relevant questions are: 
What kind of an instrunnent will be Administered? What does the in- 
strumen^ measure and how validly? For instance, does the reading 
test assess exposure to certain vocabularly, which is highly dependent 

c 

on specific kinds of reading, and thus does not really measure reading 
skill? Similarly, does the test require fln^^nry in^ ce,rtain language 
or dialect that biases the results against certain groups of children? 
Does the ^ath test really m*easure understanding of mathematical 
concepts and ability to perform math operations or does it assess famili- 
arity with certain kinds of experience, or does it basicallyassess read 
reading ability? These issues are dealt with more ^ully in the instru- 
ment section of this report. t 



(2) Non-i3ognitiye Student Outcomes 

ThSre are five attitudinal dimensions that ai:e^ 
potentially affected by a student's experience in a type of individualized 
or standardized instructiqnal program. First, students develop attitudes 
about the subject-matter (in this particular case the focus is on math and 
reading), and it is probable that s^uch attitudes have some impact upon 
as well as being impacted upon by a student's achievement in the subject 
area. Darrow and Ho\yes (.i960) contend that individualized instructional 
programs foster more positive attitudes toward the relevant subject ^ 
matter (via, reading) then supposedly non-individualized programs. 

Second, as a result of their experience in different typea ofan-, ^ 
structional programs students develop attitudes about schooL Some 
students may like attending school, in ^fsict, they txiay- prefer it^to staying 
hpme or playing in the neighborhood, while other children have a negative 
attitude toward school attendance. 
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In addition, to assessing this attitudinal dimension via a'ttitudc 
scales (especially nneasures of enjoying school or amdety toward conning 



to schpol), the following variables, might usQd as indicators of atti,tude 
to school attendance : " * \ 



the degree to which 
t, 

of discipline probl 



ich staff rAember^ per 
blenns; ana 



ceive a prevalence 



• the proportion of studehts abs'C^nt (or truant) during a given . 

' * * *■ 

- ^ y period of ti|gg. * , 

.There is sotpe evidence that ^4ndi vidualized^^ instructional programs 
tend to reduce the absence rate among student's (Darrow and Howes, 1960). 

Third, students' attitudes toward their peers emerge. Students 

jK^^^^^K^ can feel frfe^a^l^ toward their classmates or wish they were in a class 

with'other children. It4s uncertain whe,ther individualization affects 

I such attitudes. Perhaps the tendency in individualized programs to * 

f have less group learning experiences, an occurrence that Larson 

(1973) reports is not favoraBly^ccepted by many students, ha's an 

) 

impact on the degree of liking within the class group. (Romans (1950) 

i r. . 

postulates, ^for instance, that interaction result© in stronger ♦affect. 
Thus, the reduction of interaction in individualized classrooms; if 
such obtains, may reduce feelings of liking aad disliking amdng clas^ 
mates. ) By way of contrast, it may be that students ir^ individualiz^c 
^programs form a more cohesive group, in that v/hen .students are. 

allowed to. proceed through o'^bjectives at their own* rate there is less 

\ ' ^ - " 

rekson for negative feelings towa*r^ peers because they are causing 

the class to move too slowly or too fast. . 



- Larson (1973) presents a finding relevant to this point. In a 
study/of an "individualized" versus a "standardized" math instructional 
program in Sweden, He found that students In the "individualized" 
progrann were highly £ievorable,to the practice of taking prognostic tests 
innnnediately a'fter coife4»leting an instructional unit, basically because 
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they didn't have to wait for others. Thus, negative feelings towards 

• ■ - ^ ^ .... 

peers may develop if students sjee their peerj^ as respons^ible for 

delaying the\ '^completion!' of their own work. 

Fq^urth^'there is the area of attitudes toward ^elf« This attitudinal 
dimension consists of two ma'jor subcategories: Self concept and locus 
of control. ' Although both variables have been conceived of as anteceden 
of ackdemic achieverfient (see for example, Coleman et al. , 1966) they 
c\n also be thought of as outcomes from certain schooling experiences, 
especia^Uy in the early grades^ ^ • 

Self-?concept is an importjant outcome, ^especially because of its 
potentially large effect on later educational and occupational achieve - 
ment. ^'Individualized" instructional programs ^re reported to fpst^'r 
better self -concepts that "npn-individualiz^d** p^^ograms (Darrow and 
Howes, I960; Stahl an<J.Analazone, 1970), presumably,, because no. 
student is labele'(|^as **sldw"^{Carlton an4 Moor^e,' 19t0). 

Altho^ugh locus ol control is usually dichotomized into those per- 
sons who^think they can control what happens to them /internals} and 
those . who cannot (externgils), the more useful distinction may be be- 
tween those people who^ internalize success and externalize failure 
versus those who externalize' success and internalize failure (cf. , 
Weiner, 1972). It is assumed that by providing for individual differen- 
ces a program can fo^ster a more productive perception of locus of 

# ' . ' ^ - /' ^ 

6 control among students' (see Bish^, 1971). 

r - ' • - . * 

A fifth dimension is student a ttitudes toward staff members , 

^ ■ T" 

>)7hich is. one aspect of w^^at is popularly called student-teach'ex rela-- 

tions. • This is an impojrtant outcome if only'because of the great. 

~t * * ^ / • <r . ' 

amount, of .time, which students spend with school personnel and thus 



indicate,^ t^i« quality of student life. DarroW'and Howes (I960) report 
that ^^individualization" enhances student -teacher relations. 

i 



(3) Non-Cognitive, T;6^.cher Outcomes 



Educational djicisiott mak^rs^need to be apprised 
of the impact of instructional progra^ms cm teachers arid other^ staff 

^ / ^ ^ 
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members for .two reasons. First, the way teacherjs, are affected has 
consequences for the \yay .students are treated. T6acheVs who^are not 

^satisfied with their situation are not likely td be effective with or 
pleasant to their Students. Potentially, dissatisfied teachers can have 
a deleterious effect on thei? students. ''Second, givfen the-emergent 
strength of teachers' unions educational decision makers must focus ^ 

iheir attention to teachers' needs and reactions in-order to -maintain 
'a smooth operation; v' ' . ^ 

There are four* major, attitudinal dimensions that comprise the 
teacher outcomes.. First, as implied above, th^re is the dimension 
of teacher attitudes, toward students. Some teachers like their students 
^ and others are not happy with the members of their class and manage 
to escape from their company as often 'as* po*ssible. ^rhaps the type 
of individu^iz'eCprograyn affects such teacher attitudes. 

Second, attitudes toward colleagues is also an important dimen- 
sion. The nature of coUeaguial relations has been shown to aff^t„^ 
students (McPhef|pon, 1972), and therefore if certain kinds of individu- 
alized instructi'onaj programs, because of time and organizational 
demands, have a negative effect on coUeaguial relations, thfln" educa- 
tional decision makers need to be aware of this. 



Third, there<is the area of teacher attitudes toward their job and 
the school. Again, if different kinds of inctructioual programs differ- 
entially influeriqe teacher attitudes toward their job, then such informa 
tion would prove useful to educational decision inaker^., 

r-' 

Fourth, teachers have attitudes about their^own effectiveness as 
teachers. Teachers vary on the extent to which they attribute student 
success or failure to their owir teaching performance. .The more iri- 

dividualized programs, particularly if they are more or less suocess- 

\ " I ' • ■ ' ' 

fal may enhance a teacher's inteifnal 'sense' of effectiveness. This 

variable, teacher l^cus of c3ntrol , is discussed in more detail under 

input variables. ^ ^ , / . ' 

»c. Context Variables 

Contextual variables refer to aspects or factors 
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which describe 'the extra^dassroorn instructional environmjent or 
background conditions, 'fhe single most importarit contextual variable 
is likely to be the amount of resources expended on individualization 
and instructional staff including related costs associated with teaching. 
It does not include many other items that ar^ often grouped under 
' the heading of ^^instructional^expenseS** unless the^y are specifically 
"targeted to reading or mathematics instruction. It should be recog- . 
niz^d/ however, that *'per capita expenditure" may not be Unearly 
related to either the exte^it^of individualization or l^el of student per- 
fprmance (McDermott & Klein, 1974).* The re'ason^ for tliis is that , ; . 
having mpre money or, time to spend on instruction does not guarantee 
that it will be spent wisely. On the dther hand/ the availability of funds 
and support staff may have an important bearing on the form or nature 
of the kind of individualized instruction that is implem^ented. For ex- 
ample, when funds are plentiful, instruction might be individualized ^ 
by varying- materials ox physical settings, whereas when funds are 
limited, individualization might ,be achieved by variations in tqacher 
'techniques (such as the use of studfent tutors). • * ' , 

Another set of contextual: factors that sho,uld be. examindBd involves 
distiicl and comrrtunity attitudes towards individualization, l^or ca- 
ample, are parents supportive of t^idea that,stu<^ents should be treated 
differently relative to their respednVe characteristics or are they 
opposed to such differentiation? To what extent is t^ere community 
involvement in coiripeAsatory education advicement? As an index of 
community involveVnent^ the existence, size and ^tendance of compen- 
satoryc^dvisory committer meetings should .be ascertained, including 
the extent and type of jresponsibility involved. • ' 

i . The research effort shouM also be ailert^ed to regional and urban 
rural distinctions. District and school ;chararcteristic0 may also be 
important, e.g., number of pupils servefd, structure or extent of 
centralization of authority And status of school integration. The 
researchers should inquire about school staff rapport, and. the extent 
and kind of control over the selection- of instructional programs. 
Principals and staff who feel they have active control over how they 

in-31 • ' • ' 

Of 



fulfill their responsibilities ard more likely to effect positive outcomes 
than those who feel helpless to anonymous authority or ^rerrjote district 
bureaucrats!^ \ ^ - r « 

.^Compensatory education program characteristics peV se, should 

4?>" ''I • . ' * 

T^e analyzed ^s a major set of contextuaKvarialjIes.- The investigators 

should attend to mstrict and school enrollment (e.g. ethnicity and 
grade level breakdown), sources and amount of funding and the total 
number and breakdown of compensatory educa'tion staf|. Larger con- 
centrated program efforts are likely to have different effects than 
smaller more isolated efforts, 

-d. Input Variables ^ . 

' > ' ' • 

In order to understand how individug^lized instruction 
operates, it is important to consider what it operates on. What are the 
student and staff givens Input variables, then, refer to aspects of. the 
class ibs^lf that are thought to affect^outcomes :^hether directly or 
through interaction with program variables. 

Certain kinds of students .may profit most from certain types of 
instruction whereo-s other kind^ of students may achieve more from* a 
different type of instruction. In recisnt years^ this has been refenj^ed 
to as "'aptitude-treatment interaction". At the present time, there is 
r\o clear indication of the nature of the student characteristics that dif- 
•ferentiate betw^^en thos^ wh0 profit most from varying types of instruct 
tion. This may be due to failure^ to focus on the right student attributes 
and/or to identify' truly different types of instructional programs and/ 
ox to gdther and analyz^ the data in a mann^er that will facilitate finding 
these inte^i?actions (such as the use of multiple moderators). On the 
other* hand, * teachers may be more willing to implement certain types 
of instructional* programs with particular kinds of students than they 
are with other kinds of students. Thus, it seems advisable to collect 
data on stud^'nts* academic abilities, sex, ethnicity, socioeconomic 
status, and related factors in order to determine which types of pro- 
g^rams are generally uged with which kinds of studentg as well as whiqh 
kinds of prdgrams are most successful with which kinds of students. 



A 

The set pf student characteristics which needs to'^be tapped 
includes: - * « • ^ „ - 

' • Demographic factors (age, ethnicity, birthplace, sex^ etc, ) 

• > Pretest academijc achievement (Reading an cj Math) 

• * Non-cognitive variables ~ 

• Native language * - , . 

• • ^ 

Likewi'Se, relevant staff characteristics should also be measured. 

*< 

They are: ' * 

• - ^Demographic factoi-s ' 

• Academic background (degrJ^and any special training) 

• Languages spoken . . . ' I 

m ^ Non-cogniti^?fe*vctrial?les n • . 

Teachers* attitudes and abilities are, of course, critical. Some 
teachers may be more willing or able ^o serve as classroom managers 
rather than instruCtprs per se, some may be more tolerant of the seem 
ing disorder associated with certain forms of individualized instruction, 
etc/ Simila;rly, some teacher s""^ may have ha'd specific training in usinjg 
individualized techniques, worked with teachers who have used these 
approaches, have tried the techniques themselves in other classes or 
subject matter areas, etc. ^ Finally, teachers* attitudes towards their 
students and the manner they feel^most comfortable in relating to these 
"students will ha^e a bearing on the extent to which these teachers are 
willing to expend the initial extra effort required to achieve^individu- 
alized instruction. For example, a standardized classroom program 
would mak^ it easier for a teacher to maintain spcial' distance with 
students and their families than would an individualized program. 

The manner in which teachers expUin student performance can 
influence what th^y do in tfte^classroom. "If" they view student perfor-' 
mance as due mostly to factors outside of thei^ control,- then'they may 
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Experience a sense of powerlessriess. Teachers will derive little - 
reward from student successes if they cannot see how they are related' 
to teaching and will be at a loss as to what to^do about poor student 
performance if they think it is due to forces' beyond theit- c'ontrol. The 
^students, who are on the other side of this, ma^ be confused and dis- 
couraged b"y their teachers' behaviours. If teachers do not feel th^ir ' 
teaching can really affect student learning they itlay.act in an incon- 
sistent mannef trying one technique^on one day, a different approach 
. on a^iother day' and not even trying oh a third day. On the more positive 
side, if the teachers makejj: clear to the student that they^ believe that 
they can control their own outcomes, it may help them to develop a 
sense of potency in the scljool setting. ^ 

If, on the other-hand,, teachers believe that they are mostly 
responsible for the successes or failures of their students, ^ they can 
gfet a great deal of reinforcement for teaching when students are doing 
well* This can be countered by the self-doubt generated when students 
do*pooflyv'' the teacher takes'^credit for a student's good performance 
* tl>fen«;"the student can be denied tfie material for Ttjaking internal attri- 
butions for his good work. At the same time, if. the teachers take 
responsibility for the student* s poor achievement, they may be helping 
them maintain a good self concept and strong motivation in the face of 
failure. ' * 

Some |*ecent experimental research has indicated that teachers 
have different explanations for student failure than they have for stu- 
dent 'success. It seems that the teachers in these studies generally 
attributed sJtudent success to their good teiaching and attributed poor 
^stucfent performance to th^., student ' s lack of atJility.or effort. CRI has 
taken t^is^finding into account in designing the Teacher Locus t)f Con- 
trol Inventory. ^ • . - . ' . 

Classroom program and facilities should also be taken into 
Account, • e. g. , non-gr^ed or open versus traditional classroom* - 
Goodlad apd 'Anderson (1^963) repopul^risfed the notion of schools with- 
out age-gra.ded classro^s./ The rather well supported assumption 
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being that there is, as much viriafcion in ability, interest, etc. , aTT>ong 
similar age' Students as among an^age-heteri^enous group of students. 
Therthrust was to break the lockstep graded curriculum, primarily to 
allow students to proceed. at their awn pace. Not surprisingly, such 
a schcxol organization has been seen to facilitate efforts to individualize 
instruction (see Anderson, 1962; Bishop, 1971; Gronlund, 1974). 

it is assumed that implementing indiyidualized instructional p^ro- 
grams (especially those that attempt to provide for variation in instruc- 
tional settings) facilitated to the extent tp_^ which physical facilities 
and equipment allow for flexibility in size and structure of instructional 
settings. Presurn^^ly, in schools where most classroom's are the 
same size and cannot be partitioned adequately, it is more difficult 
to individuali:5e instruction. . ; 

2. Instruments , ^ ^ 

In order to measure the variables that are defined and 
described in the preceding section, CRI has selected or developed a 
number of measurement instruments. Where possible, previously 
published or previously employed instruments were chosen. Selection 
was based on criteria relating to reliability, validity,\ appropriateness 
to population and form and ease of administration. These criteria are 
detailed'in the forthcomijiig discussions of each instrument or set of 
related instruments. Wiiere no previously tested and validated instru- 
ments existed which allowed for measuring variables as they ar.e 
operationally defined, CRI developed appropriate measurement tech- 
niques. The rational^ underlying the development of these instruments 
accompanies the description of each. Exhibit III-2 outlines the vari- 
ables^ in terms of the conceptual organization of this study. T?he in- 
strument(s) that should be used to assess each of these variables is 
also given. ' - , 
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Exhibit III- 2: Variables and Associated Measurement Techniques 



VARIABLES MEASURES 



f. Process Variables- 

A. Key Variables that Distinguish 
Individualistation vs. Standard- 
, , , izatibn 

1 ^ l. Rate • ... 

2. Content • ^* . 

3. Sequence . , • ' 

4. Materials ' - 

' 5. Teacher Behavior' ' 

6. ^Student Behavior 
^7.' 'Social Settipg 

8. Physical Setting . 



B. 



Other Prdpess Variables 

1. Diagnosis and Prescription • 

a.^' Frequency/ol diagnosis and 
• prescriptibn. * 



b. 



.*c. 



e. 



Formality/ipformality of 
diagnosis and prescriptio^n. 

Student attributes consid- 
ered in dicCgnosis;a^fid 
prescription.^ n ''^ ^ \ . 

Use of diagnostic info in mak- 
in'g curricula^ prescriptions'. 

^ 

Stude^ht irivplvement ih Hiagno'- 
sis' and prescripti<!)n. 



INSTRUMENTS 



Student Activity Log 
and Teacher Inter- 
Interview II 



Teacher Inter^^^iew I 



2. Utilizatioh of Instr.uctional 
Personnel s 

•S-* Utilization of aides. 

b. Utilization of croTss-ag^ tuto^&. 

c. • Utilization of certified teachers 

. d. Utilization ofc-x:urriculum 

specialist. • . >'> 

< t 
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Teacher Interview I 



• Exhibit IllrZ: Variables and Assochia^e'd Me&surement Techniques' 



VARIABLES MEASURED . ' 


. iNSTRUME-NTS . 


- ^ 3. Classroom Ivlanagement 

a. Adult/student ratio. 

' * . " b, Nurriber of different >stude^nts . _ 

teacher instructs. 

c. Physical location of reading 
— and m^th instruction. 

d. Use of homogeneous vs. 'heter- 
ogeneous grouping. * 

e. Formal scheduling .of ^eacher 
time for instryctidnaL planning. 

, t f. Injstructional time devoted to 
reading and math. 


Teacher Interview I 

4 . 
• 

* • 

Teacher Interview 11 

9 


, 5 4. , Student Progress Reporting to 
. ^ * ' Parents ... 

' a. 'Mature of reporting- ^ * 

^^ . ^ 

\b. F|*eqliency of reporting. 


Teacher Interview II 
* * 


- — ■ ^ 

' * ' — ■ ' ^ '• , 

^. Instructional Personnel* Training 

, a^ Speciji^l training of math and 

reading teachers. 

b. , Inservice training emphasis 
. — • 'on individualization. 

t i 


* * • • * « 

' t "* 

Teacher Interview I 
Teacher Interview II 


• • * " 1 

6. Stddejat/Teacfier Interactions 

a. .Variety and type of teacher 
stud^ent interactions such as 
^ * perpent of time teacher en- 
, ^ • gages in disciplining versus 

• /- instructional activity. . 

> b. Teacher .use, nf praise a.nd 
^ V . *puni8*hment.,' * 

*^ . ~ * 
* / c. Ntimber of teacher inter- 

* V actions 'with individuals ^ ^ 

versus groups. 

9 4 


^Classroom Observa- 
tion Instrument 
(Five Klinute Obser- 
vation) ■ ^ , 

« C 

• 

- ^' / .J* 
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Exhibit III -2: Variables and Associated Measurement TecKniqVies 



• VARIABLES MEASURED 


INSTRUMENTS 


7. Classroom Decor 

a. Variety of instructional equip- 
ment and materials. 
» . f 
. ^ b. "Displays of student products 
and personal items. 

c# Displays reflecting student 
jf ^ , . • ' ethnicity. 

^ ^ ^ ^ ^ 


Classroom Observa- 
tion Instrument 
(Physical Environ- 
ment Information) 

* • 


8* Classroom Activity Pattern 

a. Distribution pattern of adiillfs 
and students. > , 

^ b. Activity pattern of adults and 
>students. < , 

c. Pattern of material usage. 


Classroom Obser- 
vation Instrument 
(Classroom Chec^k 
List) 


II. • Ou^dmes 

• - *f 

A. Reading. Achievement ^ \ 


Metropolitan Achieve- 
rrient Test, Primary I 
^ Word Knowledge 
(Subte,st) 
,Reading^ 
' (Subtesth 


•Bi Math' Achievement 

» ■* 


MAT, Primary 1 . ' 
^Vfeth Concepts 
(Subtest) " 
Math Computation ^ 
(Subte3t) 


C. Student non- cognitive outcomes 
, * 1.^ ''Attitude toward subject matter. 

2. Attitude toward peei^s. 

' ' y " 

* . ? 

,1 ') 

, • 


1. * VAbput the 

* things we 
Learn" \ 

2. ' About btheV 

CKildren and • . 
Me" 

* 

• 



Scale of Schpol Attitude Survey 



X 




Exhibit III-2: Variables and Associated Measurement Techniques 



VARIABLES MEASURED 


INSTRUMENTS 


3. Attitude toward teacher . 

4. ' Attitude toward schoql. • * 

a. . Student Attendance/ 

4 » 

• \ 

b. ' Student Discipline 

" 5 , Attitude toward self. 
^ ~^.7 * 6./ Locus of Control. 

— 


3. * » 'About the 

• Teacher ,and Me" 

4, * "About Me and My 

Classroom" 
a. Teacher Inter- 
Vi^ew 

^by ' * Five"Mi'fi\it6*' • 
^ : ...... Ob«^r,v=ation -^^^^ - 

» * * * ' 


5 Piers-Harris Child- 


ren' s'^Self Concept 
Scali^ 

6, ' Student Liicy.s^QX.^,- .. 
Con^ql Measure 

* (CRL) 


D. / Te^^cher non-cognitive outcomes 

/ ^ ' ' ' 
* / 1. Attitude 'taward students. 

- 2/ 'Attitudes toward;coll6a*gues, 

job and school. 
" ^. . * 

3, * Locus of control. , 


K i Minnesota Teacher 
, Attitude Inventory 

^2, Purdue Teacher ^ 
Opionnaire 

^X* Locus of Control 
1 Inventory for 
k ' 1 eacners \\*^r\.x/ 


III; Context Variables 

9 'A. Urban/rural school J 
• Geographic region 


V* 

'Sample. Character! Sties 


, * ' Glass size 


♦ 

Teacher Interview I 


'D. Number of pupils served by 
district 

E. ' • Status of school integration , 

F. - *Group^s involved in selection 
* ' /of instructional programs 


Principal Questionnaii'e 

. *^ ✓ 
f 



♦ Scale of Schpol Attitude Survey 
■ * ' ' .m-39 



Exhibit iII-2: . Variables and Associated Measurement Techniques 



VARIABLES MEASURED 



INSTRUMENTS 



.G» School enrollment * 

H. > Sources and amjDunt of - 

comperisatory education funds 

_ rf&mhear-and br^akdiswn of 
!nr^.*^Q?^Pensatpry ^ducStion staff 



s 



4 



,..'rr7r ::J:™- . Par en£s^attitudp.5.^toward. 



"^ft P^^^^^pil 0^ i^rogram 



' 'School staff rapport 



""^^.ff involvement in school 
11 ^* r' -Lfi^^l decisions 



6' Ti: 



'Parent involvement and influ- 
ei;ice on School level decisions ^ 



O. length bf tirpe program-in 
operation ' ^ ' 

P4 •Parent. Support of 
i' instructional program 



IV. Input V?iriables ^ , 

A^ Reading Achievement 



B . Maflf Achievement 



Principal 

Qii^estionnaire 



Principal Questionnaire 
Teacher Interview II 



;Teacher Interview II 



' MetroJoIitan Achi^e - 
ment Test , Primary 1 
Word Knowledge 
(Subtest) 
^ Reading 
(Sut>test) 



Student Noti- Cognitive Ini^ul^ 



,^ At?ti|p^de towa,;:d subject 



11 



'I (j2i'^^'^ttftud4 tgWaid peerjs .V 




e purvey 

\ . ? I 



MAT, Primary 1 
^ath Cbnde'pts 
(Surest) 
■ Math' Cpmputatibn 
(Subtest) . 



i-' "About the -Things 
Wp Learn'* 

{' - 
\ * "Abajit Other Children 

\\ and Me" 



Exhibit III-Z; Variables ^nd Associated Measuremenir'Techniques 



^' " VARIABLES "measured 


.INSTRUMENTS 


3» Attitude toward teacher 
« 

4. Attitude toward school 

5. Attitude toward self ' 

6. Locus of Control 


* "About the 'Teacher 
and Me" 

*^ -Muo ut ivie ano ^y , 
Classroom'* 

Piers-Harris Children's 


Self ioonoept Scale 

f 

•Student Locus of 
Control Measure (CRI) 


D.' Teacher Non-Cognitive 
Outcomes 

_ Attijrude toward students 

^ 2. Attitudes toward coll- 
eagues, job and school 


Minnesota Teacher 
Attitude Inventory 

Purdue Teacher 
Opinionxiaii:e 

Locus of Control 
Inventory for Teachers 
(CRI) < 


E. Student Demographic * 
factors 


^ « 

Metropolitan Achieve- 
ment i est 


F. Class transiency rate 


' Student Activity Log 




G. S^dent ,native language ^ 

H. Teacher dpmographjLc factors 

1 I. Teacher academic background 

1 ^ * e 
J. Languages ^poken b^y teacher' 

1 ^ 


Teacher Interview I 
*• 


1 


K. Criteria for assigning students' 
to classes {graded/non- graded) 


Principal Questionnaire 


1 
1 

i J 

1 

! 

il 


M.| 

o. 


Flexibility of classroom facilities 

Presence of a variety of instruct- 
ional materials 

Degree classroom is scaled to 
students ^ 

j Presence of a variety of toys, 
play equipment, etc. • 


Physical Environment 
Information 

* • 



^ Scale 



of School Attitude Survey ^ ^ 
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•a. ' The Student Activity Log . 

The Student Activity Log is a technique CRI has 
devised to measure the extent of individualization/standardization 
•within the cfes'srpom. ThBse .processes are/operationally defined by 
variation along the eight dimensions of (1) content of obj^ctiyes, 
(2) rate at which different students p^rpceed through the same objec- 
tives, (3) sequence'of objectives, (4) materials used by different 
students on the same objectives, (5) teacher behavior, (6) student 
activity, (7) social setting and (8) physical setting. Measurement of 
' thes*e variables'is problematic for two major reasons. 

i ^ • , These phenomena are manifested over an extended period 
, of time. For example, it would take several weeks or 
months to accurately assess whether all, Students, .some 
^ ^ students or no students Work on objectives in the same 

sequence, , ^ < 

• The visible behaviors which accompany these variables 

' , must be referenced to the specific objective a -particular 

*] ' ' • " pupil is ^?s^orking on. For example, if several students 

' • arfe using different materi*als at a given time, it is not 

. . an ifvdication of variation in materials as d.efined earlier 

unless the students are working on the same objective. 

' / . • ' ' ^ ^ , ' 

CRI feels that these problems preclude^ the use of in-depth ob-^ 

servation as a means- of obtaining data on degree of^individualiz^tioji 

of instruction. * In the firsl'place, the long terixn observation by re- 

search staff members which would be necessary to measure the cru-' 

cial variables would be prohibitively expensivg. S'econdly, even if 

cost were not a factor classroom observation can only record the 

physical events in the*" classroom. Tfie observer would not be able to 

link behaviors to specific *ob^ctiv*es without <:on3tantly consulting the 

teacher and intruding upon the class. CRI believes these.,problemS2 

can be resolved best by involving classroom teachers as participant 

observers in their own* classrooms to collect "data on these dimen- * 

♦ 

siojis. ^ . ' • 



' in,,42 



ERIC ■ ^ . . " / 



TKe StiCderit Activity Log and related ^5;^terii£tls comprise a kit 

which is de^sighed to enable teacheVs to ipake' systematic records of 

the jactivities of students in their ^classroom in a simple, straight^ ' 

forward manner. Tiie Log, included in Appendix F*^ has space for 

ftie liaincies of all students in the class and a set of objectives for 

' * * ^ • ' * • ' 

veither reading or math. The list of objectives is developed by the 

^teapher in conjunction with a Project Staff Member^aiid is specific 
to her/his class., On the Dog, the teacher recprds the" date on which 
each student begins any objective on which that student may work, 
the*date the stiident completes the objectJVe and the approximate num- 
ber of houts spent %n tfcat objective. Using code symbols^, the teache 
also indicates any materials, physical settings, ^social setti;igs, 
teacher behaviors ajid student behaviors associated with that student^ 5 
work on a particular oitjective. ^ ^ . 

To, facilitate teachers', recording of this information. Coding . 
Keys are provided in the Kit along with instructions for using the 
Littg, also included in Appendix F. The Coding Kfey contains standard 
items and codes for teacher behavior, social setting, physical setting 
and pupil behavior^ Since t;here is tremendous variation in materials 
among classrooms, ,each teacher. will be,aided in constructing a list ^ 
of materials appropriate to his/her class. Information on scoring an 
analysis of the Log in conjdnction^with the Teacher Interview II is in- 
cluded in Appendix G. ' , * 

Once the Log is set up and the teacher is familiar with the code 
and use of the Log, the actual recordings will require a minimum of 
teacher timfe and effort. This is important in,' maintaining teacher 
cooperation and accurate, up-to-date records, 

CRI recogni-zes that having teachers participate as members of 
the research st^iff, -collecting data about the' instructional processes 
in theij classrooms can introduce a major source o^ bias in the 
results of the study. If teachers are 'asked to make many inferences 
about the nfit\re of the instr,uctional process tbat is obtained in their 
classroom, Wey are'^tpt to do so in a ^ay that positively biases the 
picture ofjm«l\^ classroom. The Student Activity Kft drastically ' 
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reduces this problem by providing a format allowing for only highly , 
^objective information. Avhich is de.scriptive ^rather than evaluative iir 
nature. In.addition, as parl^ of the Teacher Interview I, the Project 
Staff Member will be emphasizing to the teacher that his/her class- 
room was selected for this study, because of the way it is organized^^ 
a1?d that there are no preconceptions, of how effective different organ- 
izations are. While there may be a bias in the educational commuh- 
ity toward individualization CRI fisels that the possible desire to look 
individualized will be offset by the fact that it is easier for the teacher 
to fill out the log to reflect a more standardized program by grouping 
students and making a si^ngle'e^try for the group's^ activities. 

While the use of the Student Activity Log Kit resolves the prob- 
lems of using teachers to collect objective data about their own class- 
rooms/ it presents one major problem how will the cooperation and 
diligent efforts of teachers in the sample be assured, CRI believes 
thajt tKis can he addressed in two ways. First, by paying teachers 
($100) for their involvement, part of the motivation problem shoi^ld be 
overcome. However, even when individuals receive financial renum- 
et-ation they often fail to complete their assigned tasks adequately or 
on time^ This is especially relevant in the case of teachers^who have 
tremendously time consufning responsibilities to begin with. There- 
fore teachers should be requested to send in copies of their Log at the 

* • ^ 

end of each week. Making copies will be accomplished through the use 

r 

of pressure sensitive paper. Having teachers send in their logs will 
allow project personnel to keep track of. whether or not teachers are 
keeping their logs up to date and to provide feedback to teachers who 
may be having difficulties. 

In addition to serving as a t;echnique to enable teachers to sys- 
Vematically gather data, the introduction of the Student Activity^ 'Log 
into the classroom can be conceived of as a treatmlppt, potentially 
having some effect on the ijiature of classrqom practices and/or the 
amount of learning that occurs, CRI does not believe that this is a 
serious problem since all classrooms in the -etudy are given the same 
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''treatmenh CRI» position is that th,e impact of the Student Activity 
Log will be uniform*across classrooms, regardless of the degree of 
individualization. If, in fact, the introduction of the kit into cla'ss- 
rooms enhances achievement uniformly, then so much the better. 
CRI believes that research effcMrt^ should have direct payoffs for those 
being studied, and a more immediate payoff than enhancing student 
^chiivement during the course of the study (and perha,ps subsequently) 
does not exist. * 

b. Classroom Observation Instrument (COI ) 

While observation^fjcl^g5jy3iX3Lms-4^-Kiee^ 
"^menFof the process of individualization it is a 
highly desirable technique for obtaining information on other process 
variables, input variables and outcomes.^ Specifically, observation 
should be used to describe the physical characteristics of classrooms 
including flexibility of space, presence and use of various instructional 
materials and play "equipment. Observation should also be used foi> 
noting the presence of materials which reflect personal^cKaracteristics 
of students. General teacher behaviors such as the use of reinforce- 
ment and responsiveness to^ students as well as whether .the teacher 
interacts w^th individual students or groups should also be recorded.. 
Additionally, observations should be made of the different sizes oi 
groups in which students work, the activities associated with, these 
groups, the presence of adults in groups of students sffii'd the physical 
settings in which the groups work. 

The COI is a three part observatiom instrument developed by 
Stanford Research Institut^ (SRI) for Project Follow Throjigh (Stallings 

and Kaskowitz, 1973). It was designed to describe classroom features 
activities and interactions. CRI previously employed this inatrumerit 
successfully in its study of Teacher Corps Projects (Marsh, etf al.,. 
1973), and feels that of the great number of classroom observation 
instruments availa'ble (See Medly & Mitzel, 1963), the COI is the most 
appropriate lot the present study. Some of the reasons for this decision 
are listed oji the following page. 
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The COL has been shown to have high interobserver reli^- 
bilityr/ ^0.82 vehen^alculated as a'percent of agreement 
with two raters .rating the same phenomenon). 

SRI has an established intensive program for trailing 
observers in the use of these instruments. 

Nearly all of the data collected^ by the CQI^is low inference 
which promotes accuracy as well a^ reliability. _____ 



jr^'^TRe instrument' allows fo^ intense observation of interac- 
tion between teacher <tnd students. *This is highly desir- 
able for providing a rich description of these behaviors. 

• The instrument was designed originally for observation 
of third grade classrooms whichsare also the object of 
observation in this study. 



The COI contains three sub-parts; a Classroom Check List, 
Physical Environment Information, and Five-Minute Observation-as 
described belOW: 

<r J, • ^ 

(1) ' Physical Environment Information (PEI) 

The Physical Environment Information section 
, provides a form for coding information about the classroom setting 
including the presence and use of specific equipment, instructional 
materials, games, toys ajid displays in the room. Additional recor'd- 
ings include whether the classroom has movable ratli'er than stationary 
desks, chairs and tables, and whether seating and group composition 
are. assigned by the teacher or selectejd by the stu^en!\s. The extent, 
to which furnishings and facilities in the V6om are scaled to children 
as wall as the presence of personalized displays such as student prod- 
ucts and photographs is also recorded. , . 

(2) ' Classroom ChecL List (CCL)> 

The Classroom Check List is to, be completed 
four time9 an hour. It provides a description of,the classroom at 
given moment in time^ This "snapshot'* rejcords the activities engaged 
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in and the distribution of all adults and students in the classroom. 
Information is gathered on the size of various groupings of students 
and adults as well as the particular activity they arjg occupied with. ' 
In this way, a number of simultaheoufe activities tan be hiappued. ^he 
materials being used in each^activily are also -recorded. 

— — ^ (3) — -^-h e-^i V Mi nute-Qb ser vation ( F MO ) . . 



The Five Minute Observation allows for com- 



prehens-ive rec9rding of the activities and interactions of auy desig- 
nated perschi in the classroom. Four times each hour an adult or 
child in^the classroom is selected and becomes the focus of observa- 
tion for five minute^. Each unit of interaction; in which the focus 
person is either the actor or the recipient of ^^ome action is recorded 
in a separate frame of the instrument. .(See Exhibit III-3;for a sample 
frame). Over the five minute period at least 5 0 and uj) to 7-6 frames 
are filled'out about the focus person. If one frame records that the 
focus person engages in an action"^that calls for or elicits a response', 
the nature of the^response or the absence of an appropriate response 
is recorded in the subsequent ^rame. If the focus person's action does 
not call for a response (e.g. -teacher lecturing) then the next, frame is 
used to follow the primary action. 

Each recording frame is designed to collect foar categorielB of 
information.' ' / , - ' 

^ " - ^ Who is acting? 

- . .To Whom is the action directed? 

« 

WTiat is the action? . 

^ How is it dope ? / 

p - , ^- • 

A listing of the contents of each of these coding categories is found in 

Exhibit III-4. It can be seen that the. WTio and To Whom categories 

- , « ■ — — J * * 

contain the same items and allow fbr gt^oups as well as individuals to 

be eitier actor of , recipient. The What category includes vferbal 

and o<>n-verbal actions as well as inactioti, (e. g. Waiting or No Response). 
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Who 



3 



To Wfiom 
©®© 



What 



©*©@©©®©'0© 



©^®®®®@©© 



©®©©<S>©©0©'©® 1S^@®© 



How 



A complete interaction sequence will take two or more frames showing at least ti>e initiation of an interaction and 
the response to that initial interaction. Ao example of an interaction sequence is shown below. 



Teacher: . "Johnny, what is two 
^ and two?" 



The teacher (X In the Who column) is initiating an interaction with a 
child (C in the To whom column) by asking a simple question (1Q in 
the What and How columns). (A more detaiW explanation of the 
codes appe^s in Appendix 0.) Jhis is coded in shorthand as TCI QA. 
It is coded in the frame as shown befoW.*^ 



12 

®©@© 



, Who 
§®© 



To Whom 

©©©. 
^©© 



What 



«©©®®®©'©© 

©©®®®: 



9 ©.I 

©®©©®i®©©®©© ^^©©© rar^ 



How 



Johnny: "It is four/' 



. Johnny (C in thje Who column) re^nds (3A in the,What and How 
column) to the teacher (T io the T6 whom column). This in shorthand 
isCT3A, It is doded in the frame as shown below. 4 ^ 



Teacher: "That is correct, 
f 

Johnny." 
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Who 



@©®© 

31©© 



To Whom 
a©© 



What f^ow 

(i>(2)^®®®©®© 

©@®®®|@©© 



©©©©@®©©@©© |^@®© 



The teacher (T in the Who column), tslls Johnny (C in the To whom 
column)^ that she acknowledges C7A In the What and How column) his 
correct response. This in shorthand isTC7A. It is coded in the frame 
as shown below. 



Who 

®»®® 

®©@© 



To Whom 

©©© ' 

a©© 



©©©0©©©©®0© f^©©© 



What 



©©©©©©©©© 

©a©®®©©© 



Hov 



Exhibit III- 3. CODED FMO FRAMES SHOWING CODING OF A TYPICAL ;[NTEElACTION 



(From Stailings & Ka^skowitz, 1973) 
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WHO and TO WHOM 



Categories 



Teacher 
Aide 

Volunteer ^ 
Child 

JDifferent child 
Two children 
SmaJl group 

Animal 
Machine 



Code 



T 

A 

V 

C 

D 

2 

S 

L 

An 
M 

I 



WHAT 
Categoi^v 



Command or Request 
Direct Question 
Open- Ended Question 
Response 

Instruction, Explanation 
General Comments/Ge^neral Action 
Task-Related Comment 
Acknowledj 
Praise 

Correctfve Feedback 
No Response 
Waiting 

Ob s e r vi ng , JLri s te ning 
' Nonverbal 
'Movement 



Code 



h IQ (Q fro'rn How column) 
2 

3 . . 

, 4 . 
5 
6 
7 
8 
9 

10 ' 
11 
12 
NV 
X 



HOW- 
Category 



Happy- 
Unhappy 
Negative 
Touch 
Questio'n 
Guide/Reason 
Punish 
Object 
Worth ^ ' 
Dramatic Play/ 

Pretend 
Academic 
Behavior 



\ 



Code 



H 
U 

N 
T 
•Q 
G 
P 
O 
W 

'DP 

A 

B 
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EXHIBIT III-4. FMO CODING CATEGORIES 

if 
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The How category i's used to modify blie What notation. 
_ For example,a teacher can provide correctivTfeedbafck.to a child in 
a positive way or negative way. The feedback can be about the 
child's general behavior or deportn\ent, or it can be about some 
academic endeavor. , . , ^' . ' 

The FMO captures the essence of an event independent of the 
specific content. For example, if a teacher is the focus person and 
^he/she l^ys to a student "Sally, you did very well on that addition^ 
problem'-Skfi event would be coded as TC8A which translates to -"Tea 
Cher praises Vhild for apademic subject matter. " The same code 
would be used regardless of the nature of the subject matter or -who 
the specific -child is. 

Of the many thousands of variables" that can b« extracted from 
data collected by'the FMO, only a smaU subset 'ar,e relevant to this \ 
study. Below is a partial list of variables which CRJ feels should be 
derived Trom the classroom observation data. The list demonstrates 
the types and range of events 'which, the FMO can be useito measure, 
as well as the relevance of these events to variables such as teacher 
behavior, student activity, student attitude toward self, teacher atti- 
tude toward children and pupil attitude toward teacher. 

y U Teacher addresses, instructs or responds to one-child. 

2. Teacher addresses, instructs or responds to two children 

3. ^ Teacher addres$es, instructs or responds to small group. 

4. Teacher addresses, instructs or responds to large group, 
, 5. Teacher, praises child .(children). 

6. Teacher gives negative corrective feedback. 



7^ Teacher gives positive corrective feedback. 

8, . Child *s expressions of self-worth, 

9. Child task persistence. 

10. . Negative Ipositive) behavior: adults to children 
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' 11. Negative (positive) behayio'r: children tcr adults. 

'* 12.^ ^eacheT'resp&nds fcb:chilli*'s^que^ 

13. -Teachei* Xesponds^to'child's question with open-ended 
' * . ^question. ' • • 

/14; Child expressions of happirves^s (unhappiness.). ^ 

/ ' 15. Child' self-instructioii, • ^ ' . 

* 16.* Child instructing oth>&r children.. 

17. Child interacts with» ma.chine or aiiimal. " ' * 

Teacher discipline 61 students consists of instances. in which the 
teacher attempts to'alter students' condCtct^r department in, class/ 
This is coded through the FMO as the l^e^cher giving a child corrective 
feedback about his/her behavior. Thfe degree o/ discipliriary action in 
ajCrlassroom is the rafia ot instances'of observ^ discipline to the total 
number b£* teacher-child interactions .obser^^ed. \,' ,^ ^ 

. — c^*^ Norm-Referenced Achiev^ement Tests for Reading 

' ^ . " *ang^lClath ' . • ' '* . 

The research design and'the students participating 
in the^present study set specific cohst?:aints ii;i -selecting the Vests for 
the assessment of student achievement. Thes*e constraints have been 



operationalized.into exact criteria which .were employed in tjie selection 
of a single instrument from the .many more or less Appropriate instru- 
ments dvaila*ble. The evaluation criteria irhpc^sed upoxi the tests are 
briefly described below. . -* * — / 



The Tests Should be'Norm^Referenced " * 

*In addition"to the practic^tl advantage that norm- referenced 

tests, provide scaled scores that are more interpretable 

'I * • ' 

than' raw scores, norm- referenced tests were decided upon 

as their achievement content covers a wide range of con- 
tent in an inipartial manner, - Criterion- referenced tests, 
being^specifically focused upon minute behaviors, are far 
more likely to be partial in their ability, to evaluate effects 
of individualizetd or standardized instruction. The impart- 
iality of-a published norm- referenced test, in addition to' • 
its general acceptability and credibility, argued for the ' 
exclusion of special criterion- referenced instruments. 

The Tests Should Measure Common Content of Both 
Reading and Mathematics Achievement 

The test should have at least two subscales ^so that scores 
on' reading and mathematics can be separately obtairied. 
"Further, common content of the two subscales should be s 
as-surged. Availability of alternate fprms of tests is highly 
desirable/'- 

The Tests Should be Independent of Any Specific Curriculum 

* •. * ^ 
In 9;rder to fairly assess student achievements'for this pro- 
ject, the tefft instruments must in no way be designed for 
or associjcited with any specific curriculum or instructional- 
materials^ or methods. ^ " 

The Tests Should Have Norms that Represent Disadvantaged 
Students 

Tests with local orUnciden^a^l norms, as well as tests with 
national ncyrms that undfer represent students who are educa- 
tionally disadvantaged are not ipjfropriate. Such tests ^ . 
niight weir yield noi^med findings that will, aside from corn- 
parisons, mislead 1:he*reader of the project's 'report, and 
incorrectly influencp the decisions that will be based^upon 
the report. 
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- , - ^ • 

, • * 

< * " • 

The Tests S hbruld be .Machine Scorable . • 

«. ' 

Machine scorability is necessary for a project of this mag- 
nitude. ^Present-day tests can be made machine scorable- 
while still maintair^ng appropriateness for third-grade 
students, . , ' - 

The Tests Should Provide Easily Inte.rpr.etable Scores 

The tests should provide either percentile or grade- 
equivalent conversions, "so that the scores are readily 
interpretable to the rea^der of the project report. Uncom-* 
mon or unique conversion scales are unacceptable for the 
evaluation instruments. , 

The Tests Should Provide Empirical Fall and Spring Norms 

Recent studies have cast a great deal of suspicion on the 
accuracy, of normed. scores .that 'have been developed from 
tests that have been administered at bne time of the school 
, year, and^have^then been projected linearly to other times 
of Xhe school year. Particularly when the project design'^ 
will compare fall to spring scores to assess achievement 
growth, a far more precise and less ambiguous set of find- 
ings will be obtainable from tests that have 'been empirically 
normed at both fall and spring. * 

The Tests Should Not be Unduly Difficult - 

Most test publishers provide grade ranges for optimal 
appropriateness' of tests. With disadvantaged ptudents,'^ 
however, the recommended .grade rang-es ^should be treated 
as upper limits, and, • if possible, test levels ^should be 

selected that assure an adequate floor for the* test scqres. 

♦ * - * 

A test that is sinipler, having an adequate flo'or, Ayill pro- 
vide greater yarirability .and accuracy of measurement, thus.^ 
.sharpemkg the findings of the project. ^ 
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The eight evaluative criteria lifted ab^pve were i 
most recent list of available publisheM tests^ This list/^1^ 
critical evaluations of. each of the tes/l and ^|ibscales appears 
PSE Elementary School Test Evaluations (HciWner, R. * et. al 197 
and encompasses over 8/300 currently available tests appropriate for 
.eLepj^ta,r.y^achpaLs,tudent6. This,:0^rJlpendiuMi of tests categorizes 
all tests by the curricular area assessed by tl:i^ test. The first step 
^^nimpiemeirtatimf-c^fh^^Vvalu^^^ therefore, to. select 

the curricular categories appropriate i^^ssess^ent in tl%s project. 

(1) Readinfe Cur^Acuiaf\A.reas ^ ^, J 

^® 5}^*!^ cornmpp. cu^Hcular ob^ctiv^e^- for 
reading instruction at the third' gJF^de.a^e^Undoubtedly' rel^j^d,'^ i^ord 
recognition and reding compreh€4^ion.ii h:^^^^^^ we^e'n^a^ly 
translated into the folio wifig two curricumr^'boa^s froi^ t&e dsM klem- 




entary School Test Evaluations 



^SiS.-^^ syjiJ^^r^ 4i^nf&nynis. I^Awrdilferen- 



-:^^rJ^-^^^v--^:--^i^strations, synoHynirs, <:^,r ^nfanynis. ^py/s different 
me|^nings;that the, same w^jrd may communicate. 

' • ^ ' ' ^ ' ^ ^'^^ :^ * 

' m Reading Compile nsion ^1 

' \ Understands material read. Infers the meaning of words 

{^om context. Follows ^written directions. Identifies topic^ 
^ sentences, main ideas, and intentions of the author, and* 

'finds supporting details and illustrations in the text. Keeps 
' track of temporal sequences, spatial order, and other 
, ^ relationships, ileads^ at a rate appropriate to the material 

and" purpose. / 

. . . ' (2) Mathema:tics Curricu lar Areas 

k ' ' ' 

Thi-^d-grade-instruction in mathernatics is 

still undergoing change throughout the nation, J s-o that selectioii of. one ' 

* . 'I • ' 

or two specific curricular areas that a^^very commonly addressed in 
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instruction is more difficult. In the service of impartiality to differ- 
ences in individualized yersus standardiz^ed instruction/ hOwever, the 
test should assess both concepts and computation. These two general 
curricular goals can he ti^anslated into the following goals oi the GgE 
Elementary School Test Evaluations , 

• Understattalng Math Concepts . . ^ 

Understands number,s ^nd fractions. Differentiates between 

•5 

numerals, "prime and composite numbers'.' Identifies fac- 
tors, multiples, and relative'^rimes of a given number. 
Understands set' member ship, set relations, set corres- 
, pondence, and operations with sets. Relates set notation 
and diagrams to categorical statements in English, 'Reads, 
. . * recites, and writes numbers, ^Understands place values, 
the roundiag of numbers, the decimal system of numera- 
I ' , tion, numeration with bases other than ten, and Roman . 

^ ^ numerals. Understands the commutative, associative, and 

j / distributive properties, inverse operatiotis,^ propertie's of 

0 and negatives, and rex:iprocal3. Understands number 
line diagrams. Finds and- evaluates simple numerical 
rules based on observation. Understands number relation- 
^ * •* ships, number sent;ences, variables, and formulas.. Reads 
sentences using letters or frames and equality or inequal- 
ity signs, and relates them to quantitative statements in 
English, .Solves or graphs equations and inequalities* 
Tests relations, for reflexivity, symmetry, and transitivity, 

^ Whole Number Cornputation , * 

AddSj subtracts, Ind multiplies integers,, checks answers. 

, ^ The eight evaluative critleria were successfully imposed upon the 

tests that were categorized into the curricular goal cireas listed*d.bove, 

i * 

Imposition of the criteria quickly reduced the number of qualifying tests 
from several hundred to two achievement batteries.. The two batteries 
were the Metropolitan ^hieVement Tests and the Stanford Achievement 
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Testg. In order to resolve the competition .between the two batteries, 
thQ_|est items were inspepted and were judged for general appropriate 
ne^s for disadvantaged stu4ents.. On this basis the 'following were 



,s tne loiiow^ng 

selected for the assessment oS-achievement growth in the Project 
• Reading Test A • - ' 

^ Metropolitan Achievemelit Test/Prirtiary 1 (designed foT 
* / ^ grades 1. 5 - 2. 4 but provides 

, ' norms for-gra'des l.# - 4.7). 
? *; Word Knowledge ^ • 

, ' (subtest) * • ' 

Reading 

. ' ' ' ' (subtest) t||r 

: • Mathematics Test - ' * ^ ' 

Metropolitan Achievement T^st, Primary 1 (designed for 

grades 1.5 - 2.4, but provides 
' ^* •,. * norms fo;* grades 1. 0 - 4.7). 



^ Mathematics Concepts 
9 - (subtest) 

/ Mathematics Computation. 

(subtest), ' ' I'' . ' ' ' ^ . 

d. Measures of Student Affect 

The criteria to be'empl'oyed in the selection of meas>- 
ures of s^tudent affective outcorhe are considerably different from those 
employed'' for the selection of achievement outqoipies. . Ih gei^eral, 
affective measures, if they are published at all, are not nearly as well 
normed and stscnd^rdized as most of the achi/syement tests ^nd there- 
fore their evaluative criteria must be relaxed ih terms^of the statis- - 
tical and ^psychometric qualities associated with outcome measures. 
Nonetheless, this project does itppos^ some necessary and d'e.sirable.' 
qualiti^ upon which student affective outcome rrfeasures should be 
sele'cted. These evaluative criterias are desc'ribed below, . * 



The Students Shoifld Respond on the Measure 

Although many ♦of student affective measures are based upon 
teacher rating^ pf the. students as reflections of student levels 
o'f affect*, this project also will assess teacher affect,^ and any 
teachex affect would logically confound, their ratings a^^jitud- 
ents*. For this reason, a prime consideration in thej^^ectr 
. ion erf the mea.sure is that tlie studenfs themselves respond 
*to the meas^ire. «^ ' . 

Th'e .Measure Should be Well De.gcribed . • \ 

^eca\ise there is much less concensus regarding the, goals of 
affectiv'C outcomes in students, it is m^t important that the 

* test be clearly described in terms of the behaviors it is in- 
telid^d to iVieasui*e or the theory in which •it is rooted, ^ Just-, 
iffcation of item s»elecfeon or deveflojJment and iHatches to a , 
logic'al organization of affectiv^e behaviors is desirable. 

The Itemi^ Should.be Appropriate to Third- Grade *St\ldents 

t» . ., 

* The effective items sho-uldbe drawn ^ that third-grade • 
students have no trouble/' either rescuing them, or .understand- ^ 

^ing.. what their intent is^ Items shQuld*nbt ^qliberately appear . 
to be measures of so^mething els,e by being disguised. Items 
should, not be included that are likely to be appropriate to 
o;^ly a fraction of the students./ It'would be desirabljp that 
» ' the ^ins'trument forfhrightly let the students know what the 
te^t measures and/ho>v they can most accurately respond 
to it. 



The Tests Should be I:ndepetidenjb of Any Specific Curriculum 

\ti ord^r to assess fairly^ s^dent achievements for this pro- 
ject, the^/affective measures must not-be d^eaagned Jor or' 
/associated with ahy specific curriculunx^er instructional * 
materials or methods. , / * 
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The Tests Should be Eagily Scoi^able 

Although- machine;scorable tests woul-d be most desirable, 
' it may not be likely that such tests will exist. In that event, 

tests that are easily and objectively scored are preferable 
.to any that are difficult or subjec\:ively scored. 

The Test Should be Published or Previoustx^mployed ' 

New in'strumgfits are all too -.frequently constructed for each 
new^valuation or research study. For this project, the 
literature of student affective measures should be, searched 
in order to find the most appropriate measures foi: the 
project needs that either are published and standairdized or 
that have been employed with some degree of suc<:ess in 
previous .studies.^ Such^tests have an edgeJLn terms of hav- 
ing some vali^it;^ established for them. 



Publishea and unpublished instruments for measuring student 
affect were reviewed pn the basis of the six necessary criteria listed 
above. In addition, the tests wei'elnspected for evidence that they 
had desiret^ psychornetrjc qualities and the items were inspected for 
sUch charactefi^stics~as^ students, difficulty 

for item syntax and construction^^^Hbeptibility to response bias or 
"iooking good'V ^nd focus upon the characteristics under consideration. 
Based upon this critical exarrvination, *the following instruments^were . / 
selected for, each of the student affective outcomes; 

/(i) ' Attitudes Tow.ard Subject Matter' 

J The scale ^'About the things We Learn" of the 
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School Attitude Survey (A^^n Pre^^s, 1970)'waB selected as providing 
. a wide rang-e, of opportunities for students*to reveal their attitude's 
toward^ their school subjects. Fourteen items a-ssess ^attitudes toward 
school work^ in general, grades, homework, reading,, language arts, 
arithmetic, physical' education, and attendance, fcach of the 14 items 
is composed of a three-point .r^jti'ng scaljg, and ea^ch point on the scale 
*is described by^ an attitude statement 4ibfeit is meaningful to third-gl'ade 
students, ^ * ' ji ^ ' ' ' 

• ' ' m-58 0 : . ' . •• . . • 



• 84 



.J 



(2) Attitudes Toward School 

The scale "About Me and My Classroom*' of the 
^ School Attihide Survey was selected as providing^a wide range of oppor- 
tunities for students to reveal their generalized attitudes toward school. 
■ This scale differs from many of the more general school-attitude scales 
because it focu$es upon the child^s immediate school experience 
the classroom. Complaints-a^bettt-t-h-e-elassr oom are what translate, 
at least at the early grade levels, into attitudes to school in general. 
Tlje nine items of this scale assess att^itudes toward seating arrange- 
' ments, visibility, noise, and'being tired or hungry, and are formatted 
as three-point rating scales, each point described by a m^eaningful 
attitude statement. ' ■ 

, * (3) Attitud.es Toward Peers / 

■ The scajle "About Otfier Children and Me': of 
the School Attitude Survey was selected as providing ^a wide range'df ^ 
opportunities fo^-^students to reveal.their/generalizecl attitudes about ^ 
*feheir classmate s^^ "'^h^eight^ items of the^ scale assess Sttitudes-^towards 
"other children as bothering. one, ,^as friehds, as other's fe'eTThg t(? one/ 
aboutibeing a leader, a,bout sharingj^ and about communicating p^roblems 
an4 feelings. This wide rang,e of social interaction attitudes shoUld 
•provide a comprehensive assessment of attitudes. toward peers for this 
project. The item& are formatted similarly to thcJs^ of the othVr scal^. 

(4) V Attitudes Toward Staff * . 

- T.ne scale "About the.-Teacher and'Me" of the 

i 

School Attitude Survey was selected as providing a focus of attitudes 
.partlicularly to th,e primary staff toward which young chi Idren have 
important relationships r- thejir teachers. Previous studies hsCv^indi- 
^cate^' little or i^p diffe^^eijces In ^'ti^wdes t.^J^^^j^ore distant school 
staff such as principals OT^chqoLnuJ^es, ^wC?^i^ny studies point tffe 
l^e value of the student-teacher attitudes. The five items, in a three- 
point descriptive rating scale, assess attitudes such as the teacher's 
perceived helpfulness, the teacher's desire to call on one foF answers, 
and- characteristic s that b6ther one. - * 
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An important reason for the. selection of the (o\xr scales oLthe " 
School At titude Survey , in addition to its relatively high quality in terms 
of the evaluative criteria enumerated above,^ was ffie ^act that all fo^^r 
sca4«^re coml^nedl^into one easily administered survey, Selection of 
the survey will clearly minimize, logistic problems in the testing^of 
tbe students *in this projeqt. ^ ^ . 



(Sf -Attitud e Toward Self 

- , : * V ^ 

The tbtal score of the Piers-Harris Children's 
Self Concept Scale was selected as the measure of. this student affective 
outcome. The scale has 80 items that are answered as yes or no ahd 
all it^ms are syntactically and verbally sirpple. The, tests' major 
advantage is th^t/ uT>like many other ^eff-concept measures, its items 
have no complex sentence structures, such as dependent clauses or 
subjunctive cases. Tfie instrument has bee*n used extensively, and in 
many cases vqj^ucqessfailly in research studies. Factor analyse^ of 
the items have indicated the existence of factors called ''behavior'^ ^ 
''intellectual and school status", "physical Appearance and attributes", 
■Vanxiety", "popularity", and "happiness and satisfaction. " ' T 

((^ Student ^ocus of Control ^ . 

. , ^ ' CRI feels* that a clyldjs s-ense of control over 

various aspects of his own education^'is an importapt outcome apd one » 
that should be assessed, -Since', no published measure of locus of con- 
trol that met the desired criteria fox test selecticfn w^s found in the" 
liter9^ture sea^rch, CRI has substantially mcbdffied an extant instrument' 
such that it meets most of these' criteria. The Stude^nt Locus of Control 
Instrument (Conten|poTarv Research. Inc., 1 973) was selected. This 
instrument was developed .under contract to U30E, 1973/ for the'^ 
^Evaluation of School- Based' Right-to->Read Sites. Although the ^ 
instrup^t-was not actually used at that time, the instrufnent 
was pre-tested and validated, 

. o Tfie Intellectual Achievemfent Responsibility Scale (PAR) 
(Crandall, Katkovsky and CrandalJ, '1965) provided the pool of 
items from which CRI dr?w'l8 itefti-'s in the instrument. The' 
lAR is Resigned for administrati'on to .students in grades ,3 to:' 12. ' • 



CRI found that fiome of^the original items were inappropriate for third . 
graders bjscause of their abstractness or complexity and theSe were 
elirnirtated. The remaining items vyere simplified where necessary 
and adjusted, for "ia balance of success* related ^tems and failure 
.related items. * - 

The resultant instrument can be* administered verbally ta^individ- 
uals or groups oi children. Each item des^cribes a school related event 
and the child is asked to choose one of two explanation s^for,,the event. 
Of the alternative explanations, one attributes 'cause to some external 
source such as tli^' teacher behavior or difficulty of a test, ifhe other 
choice attributes responsibility to an internal source such as the child's 
ability or how hard he tries. * * 

e. Measures of^Teacher Affect * ; 

. , 1 . - 

Historically, there- has been less systematic inquiry 

into teacher affective outcomes that student afCective outcomes and cert- 
ainly less than the attentioVi devoted to stu'dent achievernent outcomes. 
Therefore, the criteria employed in the selection, of affective outcome 
measures for teachers must necessarily be even less rigorous than, 
those applied to student measufest CRI r..ec!og*nized that it was^unlikely 
thaj: any published instruments \^hich could be considered well, normal- 
ized or standardized were ^vail^Ci^J^ ^his project. Wit^ this i«n mind, 
the ^qualities CRI looked'^r in the instruments or itefm^ selected are 
described below: ^ 



o ^ The Teachers Should Respond tp the Measure * j 

Responses should be first-per§on and not observations or , 
ratings by principals or supervisors^ 

The Measures Should be'Well Described 

The rheasures should, if at all possible, have beejn employed 
in other research or evaluations and have beeo developed with 
a specific theory or conceptuaHzatibn af.teache»r behaviors 
clearly documented. The^items should b^ justified in terms^' 
of well documented objectives. 



The Measures Should be Independent of Individualized 
or Standardized instructional Experiences 



In order to fairly measure teacher differences as results or^ 
* * ' . ^* 

concoYnitarils of variations in instructional methods, the 

measures should not b.e based .upon or focused upon one oV 

the measures to the partial exclusion of the other.,' It 

^ w o uld be- m ost-tiesirable for the instrument^ to have been 

r developed withcAi^h^ specific instructional variations in 

this. project ^n miha. ^ ^ 

• The Measures Should be Easily Scorable 

Measures that hav*e any degree of projection or subject- 
ivity in their scoring will not be considered. Not only are 
such instruments too cost-ineffective for such a study such 
as this one, but any conclusions drawn frcJm its scores. g^re 
too subject to debate. 

• ✓ The Measures Should be Published^or Previously Employed 

/ 

Tests with some previous history causing it to have accrued 

some vaTTyjity evidence' will be preferred "over th-e develop- ^ 

' , '^ment of wholly new instruments. / : 

' ' ' ' r 

Publishjed knd unpublished instruments for measufing teacher . 

affect were reviewed on the basis of the five ^necessary'criteria'listed 

above. In addition, the instruments were inspected for evidence that ' 

they Ijad .desired psychometric qualities and that the items wuld not 

insult or invade tjhe privacy of *the teachers who would be asked to res- 

^pond to them. Based upon this, critical examination, th^JfoUciwing 

instruments were selected for exarch of the teacher aTfective outcomes. 

(1) Attitude*^ Toward Students - 

\ , i . • 

^ The Minnesota Teacher Attitude Inventory was ^ 

selected as the measure foA this afflictive teacher outcome. The instru- 
pient assesses the teacher's capacity for interpersonal relationships with 
his/Ker students, a high*sco.re indicating a progressive, pupil-cent^fed, ^ 
no n- authoritarian orientation or^a^titude toward student^.' The inventory 
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contains 150 items with a five-point agree-dis^-gree response scale. 
Items are of the following types: 

*'Y6ung people are difficult to understand the^e days. *' 

•'Teachers should not expect pupils to like them. V 

The inventory has been based upon theory of teacher behavior 
a^'l^T^s been validated iiv-&Wveral studies of 'teacher effectivehess^— 

(2) Attifudes Toward Collea^g^ies, Job and School 

This^^et of attitudes can easily be trai^la'ted 
intp an assessment of teacher morale and so the instrument selected 
was the Purdue Teacher Qpinionnaire , designed tp assess levels of 

.teachers' morale. This instri^m^t provides a total score reflecting 
the general level of teacher morale. In addition, it provides sub-score 

^r the important categories of teacher rapport with principal, satis- 
factioa'with teaching, rapport-among'^teachers , teacher salary, teacher 
load, curriculum issuers, teacher status, community support of 
education, school facilities and services and community pressures. 
This instrximent has been used extensively iifbotji research and 
evaluations. . : * ^ * 



(3) Locus of Conttol Inventory for 'Teachers , 

• • ^ — 

This instrument is derived frofn a similar f 
measure which was originally developed and yalidated for CRI^s study 
of Rig'ht-to-Read (CRI, 1973). ^ It consists of a serieb of factors which 
coujd ysed to explain student success or failure in reading cxr in 
matK^' For half the statements, *the teacher is ^sked to indicat.e how 

Strongly she believes each factor is related to sfudent success. For- 

* • . . * _ * • C 
.the other half of the items, the teacher is asked to indicate how 

• ' ' ^ . ■* » * • 

strongl/ ^ach 'factor seerAs to be related to student failure. For 
comparison puiposjes, the lists have certain items in common. Each 
statement provides a factor underlying student perforjnance \^^h is 
^ither internal 6r external to the teacher. T'he internal items incline 
such general factors as teacher clarity, teal£her f:oncern and teacher 
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ability. The external items include rho>tly student factors sUch as' 

student efforj;, ^ student motivation and aptitude. Wil:hiri...e.a,cJivlist, ... 

half th^ items are internal, to the teacher and half are external. 

" • : ' ^ ^ 

In this study we are iiijerested in vaijoables whix!^ are very 

specific to the classroom and even the pS4;^icular subject-matter. 

When teachers of ireading frll out this instrument they will be ksked 

to explain student performance in reading while math teachers will 

be asked to>reference the various items to their experience. in 

teaching m^th. This is part of CRI^s overaU eMt^t to anchor data 

in the everyday, occurrences of the xlassrooro. ^ [ > , 



The Locus of Control Inventory fo^r Teachers can Be analyzed 
for internalllfy and exteirnallity main effects and for the interaction 
between these effects and succ'ess and failure. Contrary to one of 
the criteria used for selection other measures of teacher tiffect, 

,this inventory coatains several items which werejj^itten specifically 
to reflect our cohceptualizatibn of individualized instruction. For 

. example, teachers will.be giyezi factors such a^ student s elf -pacing 
and be afeked to indicate how strongly related these are to student' 
success or. failure. ^ ) ^ ^_ • 

.^f. ' Teacher, Interview^ I. . - - ^' 

This teacher interview schedulA which is to lie 
administered at the onset p'f the iield'portion of tlie study serves two 
purposes. _ F,i3^st it gathrers information^on the frequency and manner' 
irx which the' teacher diagnosed student needs V ,This includes the. * 
procedures used, the .materials such as tests' employed and the way^a " 
"in which the teacher uses, tljis diagnostic!^ infoTmafrion for. prescription 
.of instruction. Second, -it collects context and, general progr.es^ infor- 
mation. Examples of^this^are presence jpf other a^ultg in the.classroom 
class size, use of peer cross-age tutoring, use of_§,pecial-labs. a;nd 
domina^nt language of students. ^ ^ . ' / . _ 

with administration of the^Teachet Interview I, ' ' - 
tlie^Project staff Member shoul<i,give the teacher z. thorough orientation- 
to the^ -purpose and u$e of the Stu^JeriW^ctivity Log Kit. ' s' ^ * 



^ This interview takes place at the end of the 'field 

portion of the study and is intended to assess process, context and some 
outcome information that would not. have be^en available earlier. The 
teacher is asked for information releva^t-4o-4wihU^is=^im^ spent- on 
various taskST— s-chedtded time away from class fo^* instructional 
planning, any inservice training concernLog individualization, length 
of time program has been ip. operation, and student attendance patterns. 
Other data is obtained about parent and community inyolvenrient as well 
teacher participation in school decis'ions. * 

As part of Teacher Interview II, teachers should be^^rieied on' 
-their use of the Log. Inquiry should be made 5is tq the basis for' 
differences^ if any, in rate, sequence, , content of objectives, materials, 
physical and social settings teacher_i)ehavior* and student activity that 
are 'indicated on the^Log. This part, of the interview is important for 
an ^understanding of the relationship between diagnosis, prescription 
and implemeritation of instruction as it occur re'd in a particular class- 
Boom program.. Additi6^ial information on analysis of the Log and 
Teacher Interview H is included in Appendix G. 



At the end of the interview t-t 



&hould~l>e-a-sted to^appriase 



the Log. This sh'duld help assess what effect, if any, * using the Log 
during the period of the* study^^had on class 

h. Principal Questionnair a. 



room process. 



Principals of all schools involved in the study should 
be~give^n a short questionnaire te obtain information on the school and 
communityl that is not generally available throu^ teachers. Such in7^ 
formation as expendittire per pupil, criterici for as'signing students to 
different clcfss.es, staff involyi^^^|: Ji^ school decis ions , parent 
involvement in policy decisions, and certain school characteristics 
should -be assessed. ' \ , * ' 



.V 3v - Instrument Pre-lesting 



'Each instriirhenjfc developed for and /or being used for* the. . J., 
firsti^tinie yi this study- will un.de^gq a pre«-test to dfeterrnine the • 
.,piarity' ofindiyiduai item the'int^rpretation and/raeanings that various ' 
■ respojid'ents^ma^^ assail to items,,^ and any other problems that'may be 
,^^ilii^tfer^ rule, ins4;itument^.pr-e-tes-tiBg— f—* 

/ish^q^^ r^pjfc be tke stu^y sample. W rather on a 

q omparlaol^ and preferably Joc^l sample which reflects the target 
popidation. * $mce instrumerits «vill .have to be ready for use at the 
befgihning c/f^the, nq^mal 'l^chool year, pre-t<^stiiig v^ilL have to'be^don^-' ^ ^ 
with stUY)rne;r^^e"ssion.thirci grade, leveL classes/, this may. repre>^enf. 
a slightly different population fro'm ^tFie prre usedior the^stu^y but.the 
aifferences sl^ouW &6t bi 69 great as to be'i)roblematic. In a,ccordance ' s 
with OMB instrument clearance requirements, the num'ber of respon-* 
'dents lor the' dt-e^fce^fts should be nine. 

4. OMB Package , < . ^ s 

All of the instruments^X^t this study which' are discussed 
above along witfi justification for their use, justification for any 
newly created items or revised instruments and all pertinent instrviment 
administration information should fee compiled into a report for sub- 
mission to the Office^of Management and Budget (QMB) for approval/ ^ ^ 
OMB specifications fcjr this 'package should be adhered to. 
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F. DATA COLLECTION 



/!• Overview 



This data* collection procedure has been devel^oped with 
• • • » • ' » 

the intent-of devising a plan that would ensur.e High validity and relia- 
bility, that ^ould keep projedt costs withiVi an allowable range and 
-that would minimizer the inconvenience for students and school person- 
nel.; ' ' ^ ' . ^ . , 

On-site data collection is to take place during four major data 
collection periods, covering six montlrs. During this time, data are 
to be collected from cia'ssrQom teachers, aides, reading and math 
specialists, principals and student^s. Data ishould be systematically 
collected through the .use of the instruments which were designated 
in the previous section on measurement. 

An essential'element of data collection plan is the avail- ' ; 
ability and use of highly skilled data collection personnel. Therefore, 
staff training shb'ulifT be given high priority. It is also important that 
the same personnel be assigned to visit the same schools throughout 
the study, ^ - ' • . 

2. Data Collection Plan • 



The essential componertts^ of the data collection plan ar4 



included in Exhibit III-5: Data Collection" Plan, which ip^dicates for 
each of the study instruments, the method of data coUe'cnon to l^e em- 
ployed, the resporjdents for the instrument, the time period of data 
collection and| the length of time required for a^ministraiioiy 

' The total tiMe'period for*^data collection is approxirnately 6 , 

months. This time is broken down into fou,r major periods- as follows'; 

. ' * ' / ' ^ , 

D.C.J: ^bata Collection Pretest - Oct. '4 - Oct./2,9, 1976 ^ 
' I * ^ > / 

D. C. '2t Intervening Data Collection - Nov.. 15 - Dec. 17, J976 

.D. C.*«3; Intervening^ Data Collection - Jan. - Feb. 4, 1977, j 

e(. C.'4: Data Collection Post'test,- Feb. 2-1 - Mar. 18, r977 .*. 
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a. Data CoUection Pretest (D, C, 1) 4 ' 

The first major data collection pe.riod is scheduled 
for Oct. 14 through nJv. 1976. (Data collected during this period 
shoulcj be treated is pretest data). During this period, 25 data collec- ' 
tifen personnel are to visit approximately 10 schools each for 2 days per 
school. As sMown in Exhibit III-5, while on-site, they are to 1) inker- 
view the^chool principal and the master teacher of the classroom _ 
under study; 2) administer the achievement test to the 3rd grade stu- 
dents; 3) administer all non-cognitive instrument's to students and 
teachers and other instructional staff; and 4) instruct the teacher 
on the Aise of'the Student Activity Log. ^ 

Whenever feasible, those sections of the interview questionnaires 
that can be completed by the principals and teachers prioj-^to th^ staff 
visit should be mailed in advance of the visit. Also, to mstximize the; 
. use of test administration time, the teacher non-cognitive instruments 
should be administered at the same time the stu^dents are taking the 
Metropolitan Achievement Test. ^ , . 

b*. Intervening Data Collection (D. C. 2 &t D. C. 3) 

There- sh6uld be twoantervening periods of data 
collection, the fiiist -oi -which is scheduled for Nov* 15 - Dec. 17, 1976, 
aad the second of which is scheduled for Jano 1 - Feb. 4, 1977. Class- 
room observation, using the Classroom Observation Instrument, com- 
poses the primary method of data collection (during this period. Ob- 
^►servdtioaal periods in each classroom should cover two days, and 
.when feasible, the teacher should not be jiotified*of the exact 'day that 
the observer will arrive. For practical reasons, however, they should 
bcr told the- week (but ngt.the day) that observation will take place. 

o. • ' Data Collection Posttest (D-.^C. 4) 

The last ipajor data cpUection period is scheduled 
for iFeb. 21 - Mar. 18,. 1977. This (3ata coUeqtidn period should be 
treated as a posttest; therefore, all ofM:he same instruments (but wh^re 
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available, different forms) are to be adminiater;ed to the same res- 
pondents who took the pretest. Data collection should take approxi- 
mately 2 days at each school and same proc^edures for instrument ^ 
administration that were employed during D. (S\ I should be employed 
during D. 4. - , ^ 

^ [ ._ d. Student Activity Log Data, Cojllection 

^> : ' ' On^ study instrument,^ the Student Activity Log, is 

to be used throughout the entire six months of data collection. As 
described in the measurement section of this report, all of the tea- 
chei*s in the sample are to keep detailed records on the progress each 
student in the class has made on a predetermined set of ofjjectives in 

' the Student Activity Log, » . " , 

During the D. C. 1 period,* the data collection personnel' is to 
thoroughly explain to the "teacher the log and it/^use. The data collec- 
tion personne^r should mike it cle'ar to the teachers that theibg records 
are to be updated whenever there is new information to enter. They 
should be warned against letting a long period of time elapse and then 
tsrying^ESWecall the data. The duplicate cppy of each weeks \upcfate 
of the log is to be mailed to the contractor on the Friday of each 
week; however, during each of the three data collecti^pn periods (D.C. 
2, 3 and 4), the data collection staff rhember should review the log* * * 
for its accuracy and co?fipleteness and any problems that the teacher 
might be having should be discussed/ If the cdntractbr'has not 
received the w^eekly update of the log by Tuesday of each' week, tele-" 
'phone* follow-up should be conducted. . * '* ^ 

^ At the end of the entire data, collection .period; March* 18, all 
teachers are to mail a copy o^ the completed log to the contractor. 
If the log ha»s not been received within a reasonable period c5f time; 
the teacher should'*be telephoned and reminded of the urgeTiX:y of 
returning the log immediately. * ' ' , > *- 

3. ' Selection and Training of Research Sta ff 



. Data collection personnel \Vill be needed to conduct " ^ 
interviews, to do systematic classroom observations, .to administer 
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^ standar^Ji^e^ achievement t^sts, and tO Histribute and collect self-, 

administered questionnaires. Also, field supervisors are needed 

* . • ' • ' • • 

to train the field staff aitd to control the (|aaIity^o| data, collection. 

The intent in selecting and training the data collection staff is to in- 
crease the reliability and validity of the data collected, but also to 
foster positive relations with the schools Vnd communities involved 
in the study. • ' 

a, . Staff ^Selection 

Approximately 25 staff members will be needed for 
data collection; however, it.is anticipated that not all indivrduals selected 
will qua lify or will always be available. Therefore, substitute inter- 
viewers will be needed,' Abput 20% more persons should be initially 
selected and trained even though they may not actually be 'needed in 
the fie^ld, ^ . ; * < , , * 

^ Membe^rs of the data collection staff participating in on-site 
visits should be capable of 1) rapidly learning the appropriate pro- . 
' ce^iires for collecting data; 2) dealing with the data collection pro- 
^ce\s in an objective and confidential manner, an*d 3) relating well 
v/iti^ members of the local school-community, especially administra- 
tors, teacher'3 and students. 

^ \ Although good public relations could' be realizred by selecting 
members of the research staff from local commuhi^ty, given the num- 
.ber of different schools and districts in and the geographical spread 
of the sample, it is not practically feasible to use local community 
personnel. 

The composition of the entire data collection team should be 
multi-ethnic and somewhat proportioned to the ethnic /cultuiyal make- 
up of the respondents in the sample. However, it is not desiVable 
that the assignment of the data collection personnel to schools be 
done on, the basis of ethnicity alone. The prime criteria for assign^ 
ment ought to be base.d on a desire to maximize good relations with 
the school personnel and on the desire to decrease trkvel costs. / 
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Another rea'sori v^e suggest that the contractor not attempt ta directly 
ethnically match the data collection staff to ^fhe school staff and students 
is becaus^it is unrealistic to suppose or even attempt to perpetuate the 
notion that Blaclcs should work with Blacks, Whites should worlc -with 
Whites, Chicanes shoUld work with Chicanos, etc. On tlfe other hand,' 
the input of various etnnic groups into the total process is an essential 
element toward ensurirt^ inclusion of the concerns of each of the ethnic/ 
cultur^ groups involved. 

Teachers, aides, etc, , should got be given the task of administer- 
ing the achievement tests because they should be completing the teacher 
non-cognitive instruments durir^g the student testing periods, and most 
importantly, because orienting teachers about the test may 'bias the re- 

.suits by enabling teachers to "teach for the test." 

* * * > - 

b, • Data Collection Staff Training 

. - , ; " <i . • . I ' • ' 

\ Regaiyiless of prior experience, it is .essential that all 
,data collection personnel undeivgo extensive staff training, 

'( I ) Purpos< 



The purpo>ses of the 



raining are ag follows: 



To familiarize clie personnel with the 
contenkqifW oflthe stUdj^ instruments that 
=are to be Administered. 

To train tl^ii staff in the specific; procedures 
fo,r adminiMerin^, each instrument. 

To afford the^staff practice ih administering 
the instr'umencXand anticipating and answer- 
ing typical queWions of respondents. 

\ \ ' i* 

To identify the strengths and weakness ol\ 

the data collection team\8o that none of the 

member's nor individuals'^. involved are put 

in situations 'they csmnot* 'ixandle. 



, To allow the staff to identify and under- ; 

stand th^r 'own biases so that th^y will 
not impose them on the individuals and 
schools they may encounter. 

^ • To familiarize^the staff with the concep- 

tual framework of the study design and 
the' definition of individualized vs. stan- 
• » dardized instruction; 

• To familiarize the staff with the travel 
\ ^ . - ^ 

^ and other logistical pr^Dcedures they must 

follow. « * ' 

(2) T raining jSchedule 

a 

Staff, training sessions should '^e scheduled such 
that they directly precede the data collection period and should cover a 
sufficient length of time to ensure the accomplishment of all of the. above 
purposes. Because of the restricted time schedule to complete the en- 
tire study, all personnel should be^ trained at the same time so that tifain 
ing sessions need not be repeated. Each training session should cover 
the instruments and procedures to be used in t^e data collection period 
that follows. Since the D. C. 3 and D. C. 4 data collection periods 
essentially use the same procedures as the D:C. 1 and D. C. 2 peri- 
ods respectively, the training periods preceedirig D. C'V 3 and D.C. 
4 should be used^to review old procedures, changes in procedures " 
and new procedures^ and tb re-check inter- rater reliability especi- 
ally oh the SRI Observation instr\iment. , » . * 

^ The schedule of the *training periods is as follows 

Sept. 20 - Oct. 1 - T^raining fo^ the pretest data collection 

(2 weeks) peripd; D. G. I. • 

' ' S ' ' * ' 

Nov. 1,-12 - Training for the intervening data- coUec- 

(2 weeks) tion period, D.C.. 2 (classroom obser- 

vation training). * 

Jan. 3-7 - ' TraiTiing for ^he intervening data collec- 

(1 week) tion period; D.C. 3 (classroom bbser-. 

' ' ' vation review). 

'Feb. 14 19, ' ' Training for the posttest data collection 
(1 week) * ^ period; D. e. '4. 
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Training Program Content and Techniques 

With the exception of classroom observation 
traim^g^ all staff training should be conducted by in-house senior" per- 
s^nel. , Classroom observation training is to.be conducted by Stanford 
lesearch Institute (SRI), the developers of the Clt'ssroom Observation 
Instruments, as it is a very complex instrument to use. This training 
takes at least 5-10 days of intensive study. On two oc-casions in the past, 
CRI has arranged ,for "training of its own staff dn the SRI instrument 
and has found the SRI staff to be flexible, amenable and capable of meet- 
ing the specific needs. of. the sta.ff to be trained. SR.I will conduct the 
training at the contractor' s facilities, using videi-taped and real class- 
room situations. The SRI training also includes procedures which check 
inter -ratdr reliability. 

Training on all other instr umentis should be designed and con-' ^ * 
ducted by an in-house trainer. The^^raining, in general, 'should (irst 
• focus on the general techniques of unbiased interviewing, test adfnini- 
stration and classroom observation,_'fbllowed by the specific-jprocedurcs 
associated with each instrument and test. Whenever appropriate a^dio- x 
visual materials should be used such a,s overhead projections of the in- 
strument iterns arid/or instructions and tape recordings from the' instru- 
. *ment pretest sessions. ' . . ' 

All participants should be. given an opportunity to administer^he 
instrurnents to each other and participate in role playing experiences. 
A list'of.anticipated respondent questions should be developed and the 
answers discuss.ed. ' 

' - -X . 

. Each participant should be given a training manual which includes 

: the-foll,owing: » » 

, • Copies of all the study instruments 
; • ^Tnstruction for administering each^ifistrument 

m* The instrument administration schedule - / 
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Instructions for handling the data (e. g. where to mail 
data, how to package it, and how to edit it for obvious 
errors) 

A HsUof anticip'kted respondent questions and answers 

Logistical information such as travel arrangements, 
ek^ens^ vouchers, etc. 

• List af nanies and pfers.onnel to contacted at each school 
and numbers of respondents to be sarhpled 

• fiAiergency, procedures for contacting the project*^ 
principal staff, 

4, Procedures for Ensuring Respondent Cooperation 

As in any study of this nature, the quality of the data in 
many ways is dependent on the cooperation of the respondents. On 
the other hand, upcooperativeness of respondents can Become a ma- 
jor obstacle. In order to help ensure tKe cooperation of the schools 
and respondents, *CRI has developed the following procedures; 



al Follow the Lines of\Authority for Gaining Entree 
into the District * ^ 

The rQutinely accepted procedures for gaining entree 
into the district should be followed. Specifically, letters explaining 
the project s ho\^d be sent to the district superintendent with a copy to 
the compensatory education director* Following approval at that level, 
the school principal should be contacted by mail ^nd his cooperation 
sought., Only after ii^strict and schoel leveLpermission have b.een granted, 
should te.^^chers be coW^cted. Teachers should be contacted first by 
mail and then ar rangernents made for telephone contact at a time that 
does not interfere^with the teachers* teaching schedule. 
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- ■ Fully ll^ lain the Study JReguirements to Participants 

. At each level of inquiry into the district, the study's 

requirements should be fully explained. It is mor? likely that partici-. 
pants will cooperate'if thev know from the beginnirfg what i e^qpected 



of them. 

• 



Pay Teachers an^^Honorarium for Their Participation ' 
, in the Study '' 1 r^, 

» * " • 

An honorarium shbuld lie provided to teachers as an > 

added inducement for participating ih the study. CP! suggests that the 

^honorarium be set at $100 and that all teachers be paid the" same amount. 

If the study team," however, finds that the honorarium does not'motiyatb 

most teachers becauseUt is not enough, they should consider xai^ing 

• the amount of honorarium. > ' 

d. Provide th^ School with Their Students' Teat flesults 
on the Achievement and Non -Cognitive T e st s 

Student test results are often very useful to the 
teacher. and the school; therefore, the study team-should offer to pro'vide 
. them to the school. Non-cognitive test results may be most desired 
as it has been CRI's experienj:e that such information is usually difficult 
•for teachers to obtain. \ . > , . 

^' Str&ss the Side Benefits for the Classroom Teacher 
• ' in Keeping the Student Activity Log" ~ 

"^he side benefits of keeping the Student Activity Log 
i-fe that the teacher will haye an easily manageable system of tracking 
and recording the prog'ress of the students witKin the class- (at least on 
the objectives that are included). This may be an additional aid to tea- , 
chers who have found this to.be a diffii:ult task. ' ^ 

, ■ . Provi^ the School with a Copy of th4' Final Report 

Since the final report wiU include information that 
will be extremely helpful to gchools,- each school in the sample .sh^ould- " ' 
be provided a copy of the final report. 
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' ' ^;;«ig' * Ensure the Participants of X^onfidentiality 

^Procedures to ensure confid^eutiality of participants 

and their responses should be strictly enforcecf,. , Participants should 

. ' - , ?v ^ 

Be mad6 aware of the fact that nd nances of schools participants will 

be mentioned in the report, « ' <. " * 

5> ' Quality Control of the Dat:a. Collection Effort 

\\ Since the quality of the data will have tremendous impact-on 
the results of the study", the study .team should implement procedures 
that will increase the quality of tTie 4ata c'ollection effo^tr CRI suggests 
the following procedures; ^ 

a. The Deputy Project Manager Should Di^rectiy^ 
• Supervise the Data Collection 

m _ 

This individual should have prior experience , in 
supervising data collection for similar large^ scale efforts. Early , 
in the study, this individual along with the Project Manager should 
woVk out the specific details of the data collection plan and delineate 
the roles and responsibilities of assisting personnel, 

b. Field Personnel Should Review' all Questionnaires 

■ Field personnel should check all instruments for 

errors, and completeness prior to leaving the school. The instru- 
ments should a^in be* checked as they are returned to the confrac- 
tor's office. 

c. Field Personnel Supervisors Sh^ould Monitor the 
, Data CoUectToh'Effort and Check Iriter-Rater 

Reliability ^ 

. Field Personnel Supervisors should be desij;ji|Lted 
to directly monitor personnel in the field. These persons, working 
under the dire"ctibfi of the Deputy Project Ma nager^ should - travel - 
from school to school and monitor the efforts of the field personnel. 
These individuals should discuss with school per sonnel.ariy problems 
related to data collection, \i f 
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Due to the -complexity ofthe SRI Observation Instrument, one of 
t\ie prime responsibilities of the field supervisors is to monitor inter- 
rater reliability. In total the field supervisors should make no less 
than thre« inter-rater reliability checks on each observer (one during 
the pre-staff training, one during the actual on-site D. C/2 or D. C. 
3 periods, and one during the staff retraining and review period). . 

Procedurally; on-site inter-rater reliability checks will be done 
by the field supervisor and classroom observer observing and record- 
ing Ihe same phenomena. If agreement between the two raters is less 
than a .82 correlation, the field supervisor is to determine and imple- ' 
ment appropriate corrective and/or* retraining measures. 

C DATA ANALYSIS 

The overall plan for data analysis follows the three-stage outline 
of the research design described earlier. At each stage the statistical 
procedures employed are designed to provide answers to the research*^, 
question^ posed for that stage. Thus, we have organized this section 
around the stages. 

1. Stage 1 - Defining Treatments 

The major task posed during thi3 stag^e is to provide an 
accurate#summary description of existing programs with respect to 
the eight din;iensions of individualization of instruction, aftd to develops 
a typology' of these programs. 

Data analysis f9r Stage 1 should begin' quite early in t^ie research 
effort, and shoiitd form part of the basis for selection oi the final sample 
for intensive study: The sarnpling procedure involves the collection of 
data from 400 te^achers by means of a structured telephone screening 
procedure. This procedure, should yield enough information about each 
classroom to pr'dVide a basis for scoring each classroom on each of the 
eight dimensions^ of individualizatiop/standardization for both r^eading 
and math. The spring system should involve no more than four scores 
(ranging from "higlily individualized" to ''highly standardized") for each 
category. The scales would be assigned by the interviewer. _To ensure 



that the reliability of scoring is adequate, .it is suggested that a subset 

of 'the' interviews^ be scored independently by two interviewer s. This 

) ' ' ' 

procedure will yield an array ol sixteen 'individualization" scores for 
each classroom' in the sample, corresponding to the eight dimensions 
for reading and math. These arrays constitute the raw data for the 
major part of the first stage of the arialysis. * ' 

In addition, descriptive surrgnary statistics on the major contex- 
,J;ual and input variables would be compiled for each classroom, 

* ^From the arrays described above, it is possible to construct two 
different correlation matrices: (1) a matrix of correlations among 
dimensions, computed across classrooms; (2) a matrix of correlations 
acmong classrooms, computed across dimensicjnsi The matrix of 
correlations among dimensions would provide a preliminary indication 
of whether these dimensions are highly intercorrelated or unrelated. 
To the extent that the eight dimensions are all reflections of a single 
.^individualization" dimension, the correlations will tend to be quite 
high^within a given content area (reading or math), POr relation's between 
each of these dimeasions and the background yariables^.shc>uld also.be 
computed to determine whether the different types of programs seem to 
be related to the presence of certain contextual and input, variables.. To 
investigate high-order interactions among variables, multi-Nvay contin- 
gency table analysis can be employed. The exploratory* data analysis 
approach advocated by Tukey (1975) might also be 'useful,. From such ^, 
analyses a general piqture of the variability among programs will emerge 

On the basis of this exploratory analysis^ ^there should be some 
indication whether varipus classroom, .characteristics are highly inte^-, 
correlated or unrelated. However, we are l^articularly interested in 
relationships among those process variables which'a.re often thought of 
as comprising aspects of individualization, . ^ 

The classical approach to deterrriining whether ouelfbr a few) 
dimensions seem to underlie a set of separately rneasured ^^swc^bles is* 
factor analysis. Factor analysis starts With the cor relation *matrix 
among the. variables and essentially looks for linear combinations of 

^ / 
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yariaibles which account for the most^riance. The amount of variance 
abcounted.for is reflection of the amount of intercor relation amqng 
the components: of the factor; factor analysis works well when the . 
linear, ,a^ditive model it assumes. is a reasonable' api>'roximation to \ 
reality. However, we feel thafcin the present situation it would be more 
appropriate to eipplby a technique which makes fewer assumptions, and 
are, therefore, recommending the use of multi^dimensional scaling. 

In general, this technique involves first the definition of a distance 
metric between two individuals (in this case classrooms) in the space of 
all relevant variables. Multi-dimensional scaling algorithms then 
essentially determine whether there exists a sub-space of the entire • 
variable space of only a few dimensions in which the data can be ade- 
<iuately represented. These dimensions need not have any neat mathe- 
matical form, as in factor analysis. ' ^ 

j In the present case, a distance 'metric dan be defined quite easily 
fjfdm the correlations among classrooms, from the sum of the differ- 
ences between them, or some oth^r index* The scaling analysis would 
tien seek to arrange these classrooms in a space of eight* or fewer di- ' 
^nsions in such a Way that.the "distances'* are maintained. The scal- 
iEigY^goritl^ni provides a "solution" for any. given number of dimetisions, 
and/i goodness -of-fit index* can hei calculated fo^ each solution. The goal 

th4 analysis is to provide'^ the best pbssible fit with the fewest possible 
cjitnepisions. * 

Ideally, of coursie, such analyses will generate one dimension 
v^hich can be interpreted as the degree of individualization. Classrooms 
c an then.be ranked in terms of. this dimension. Of particular' interest 
vail be whethejr the classrooms fall along a continuum or into two Or 
mare discrete groups. 

The puipose of this analysis is to determine whether ^he existing 
curricular program^ f^U into natural groupings which can serve effec- 
tively as "treatments" to be compared. If as a result of the analyses 
described above, a singlfe dominant dimension intet-pretable as corres. 
ponding to individualization emerges, this task will be greatly simplified; 
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- If there daes not exist % single dimension, it may be worthwhile 
to un(ler£ake a cluster analysis . Cluster analysis is a generic name 
for a number of techniques which* attempt to divide a sample into sub<^ 
groups, pr clusters, which are themselve§\relativeiy homogeneou^ 
but which differ from other clusters*. In our situation, we would be 
attempting to find clusters of classrooms such that classes in the 
same cluster woiild have similar values on most^ariables, while 
those in different clusters would display different patterns of values. 

If there are a relatively small number of well-articulated pro- 
gram types, a cluster analysis of process variables should uncover it. , 

Classrooms should at least initially be scaled separately for ^ 
reading and math. There are two reasons for thist first, it is likely 
that some classrooms will ^'individualize" instruction for only one 
subject. Second, the patterns or types of individualization that 
emerge may differ for the two subjects, and the analysis should allow 
for this possibility. 

The results c£ the analyses during Stage 1 would serve two' Critical 
purposes: first, they wpdld form the basis for defining "treatments" in 
the study; and second, they wodld a?.d in final selection of a sample of 
• classrooms which adequately represent different combinaj^ions of treat- 
ments. Perforrriing this exploratory analysis at an early stage lias the 
additional advantage or providing a general familiarity with at. least some 
of the data and potential problems in handling it. This experience should 
facilitate the perforipance of analyses in later stages. 

It should be noted that while data from the telephone screening 
procedure will be used to develc^p the typology of programs and "to select- 
the sample of classrooms, later phases of the data cpllection procedure 
will provide additional (and probably more accurate) information on the 
way in which a given classroom actually operates*., Tlius, data fro'm 
the Student Activity Log should be used to verify and revise the ir^itial 
classification of such classroarn with respect to'treatment 'condition. ^ 
As a result of this additi-onal data, some classrooms may be reclassi- 
fied. ; ' 
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The'^st'rategy suggested for Phase 1 can be rllustrated. by apply- 
g a "seat;^- of- the -pants" maltidimensional scaling analysis to the 
* variables and data sliown in Exhibit, III- 1, which were collected durin 
the Telephone Screfening Procedure. The exhibit lists six individual- 
'ization/standarddzatiqn variables, and categorizes each-of 41 class- 
rooms as individualized fl), ^standaKdiz^d (S), or differentiated (D) ' 
with respect to each of these variables; ,If we arbitrarily score 
S = 0, D = 1, And I = ^the^e categories can be considered, numeric 
' cally ordered with respect to the degr'e^^f individualization they 
Represent. F rom this data, it is then possibje to compute a numeri- 
cal index of the "distance*' between any given pair of variables or any 
given pair of clasisrooms; The dista^ice is simplV the sum of, the 
differences betwe'en any two' variables Acx;ps3 classrooms, or arfy j 
two class rooms 'kcross variables. Conceptually, the "distance" 
between tv^o classrooms represents 'the extent to which th^y employ . 
differing ins'tructiojial, practices, across the six dimensions ^is.a 
whole,* and the "distance," between two. Variables represents the 
^extent to which their pattern of occurrence differs across cla^ssrooms. 

» For- purposes of illustration, it is simpler to focus on the/rela- 
tionships among vailiables- than among classrooms, sinjee tbe data can 
be displayed more e|conomic%lly. The diagram b'elaw shows a matrix 
whose entries reprefsent the "distances" among the. six variables 
represented in Exhibit III- i , based- on the. data In that exhibit. ' The^ 
entry-in any given cell represents ,the "distance" between the row 
variable.and the column yar;iable. -^The smaller the dista.nce, ^he 
more similar the two variabjes are in their pattern of occurrence 
across classrooms. The numbers given are based on scores for 
mathj instruction only, although the data are quite similar for reading. 

. . •'Teacher Physical 

Content Sequence Ra*te Materials Be ha vior ' Setting 

/ . > - . - ^ 
Content ' X ' 8 • 15 9 . '19 ' , 19 

Sequence ^8 X .7 4 15 17 

Rate 15 7 X , 11 . 14 ' 22 * 
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• ' Teacher Physical 

Content Sequence Hate Materials Behavior Setting 



Materials 


9 


\4 


'ii 


, X 


17 


13, 


Teacher 
. Behavior 


. 19 


15 . 


14 


* 

17 


X 


24 


Physical 
Setting 


•" 19 


1? ;^ • 


. 22 


' 13 • 


. * ■ 24 


X 



' . .It is i^eadily apparent that the , two mostjBimilar variables are 
-sequence and materials, while the two most dissimilar are teacher 
behavior and physical setting. A rough plotting of these variables 
•in two dimensions on the basis of their distances reveals that rate, ^ 
materials, sequence, and content can be easily Represented in two 
dimensions, whereas a third dimension is needed for teacher 
behavior and physical setting. Thus one da^suggest that teacher 
behavior and physical setting should not be collapsed. into the same 

^riable^j^ategory withjfce othjsr four dimensions (or with one another). 
Of'^coursffe, the actual decision as to how to defirfe treatment condi- 
. tio-ns. would invojjfe carrying out the above proc^ure across class- 
rooms rather than variaW^s, but the principles involve^ ^re the 

same. The >pf ocediire Vould yield a "0ctvire:!^bf clas^srooms, in 

^ ' 'it'A' '^'-^- ^ ' 

which those which are^imilar are clusteried together and those which 

are different are spatially separated. Tile sampling procedure would 
anyolve,^ in effect, ^plating a grid* over tl/is spatial iepresentation'and 
selecting a sam^ple of classrooms froi/ each area o|"the grid in which 
there are found to be classrooms. The size o/ the grid and the' num- 
ber of-^reas defined on it would be based on the obtained pattern of^ 
classroom' variation. ! In Exhibit III- 1, the forty-one classrooms 
display 19 distinct patterns of individualization. Some patterns are 
'quite similar to one another, and would be lumped together in the 
process, of defining treatments. The .goal would be' to select a sjriall 
nurnber of fairly distinct patterns. , ,^ ^ 

2 , ' Stage 2 Comparing Treatment Effects . • , 

During the second s.tage of the clata analysis, we will be ^ 
in a position to address the n>ain question: 'What can we say about the 



effectiveness of indivitiualized instru^ction in compensatory education,? 
Specifically, our task is to connpare outconnes for'children exposed to 
different types of instructional techniques related to the concept of indi- 
vi.dualization. This task is coraplicaJ;ed, hqwever, by the fact that a host 
^' of other variables may also affect outcomes. Thus, if we simply compare 
nriean outcomes for children exposed to "individualized'' vs. "standardized' 
programs, we l^now that there may still be biase.s as ^ result of other, 
differences among the classrooms (and their environments). One suggeste 
strategy for dealing with .this problem is the,use of multiple regression 
^ analysis . For any given outcome variable, multiple regres^on would 
specify an optimal set of linear weights for a given combination of treat- 
me,nt, contextual and process vai*iableS, accounting for the maximum 
varianc^e in outcomes. The obtained beta weights for the treatment varin 
ables would provide an estimate* of the effect of these variables, taking 
into account the effects pf other ("'ciDntrol") variables on outcomes, and 
interior relations among the predictor variables themselves. 

One difficulty, -however, in applying a multiple regressibn technique 
to'the data in the present study is -fehat the number of potential independent * 
or "predictor" varia.bles is quite large relative to the number of data 
points. Foi* this reason, it is necessary to develop a str^^tegy for' reduc- 
ing the number of variables to a manageable set,^ which will includevall 
of those which are most important. - . ^ 

There are several ways in which this might be accomplished", ^no 
Qne of which is entirely satisfactory. One approach is to use a "step-wise^ 
,regre$sion procedure, in which-new, variables are added to the regression 
equation pije s^t a time,^jLnd the importancelfof their "contribution" or 
predictive value is gauged by the extent to which they improve the pre^- 
dictive power of the equation. Unfortunately, step-wise regression can 
..be^a highly misleading way of assessing the importance of a variable, 
since. how much predictive value is adde.d depends heavily on the sta^e at 
'which the variable is introduced. ■ ' . 

Another approach would be to screen the large set of contextual and , 
^nDut variables in a prelimihary analysis, seeking to identify those which, 
are most iniportant and eliminate others from subsequent analyses. A 
variable might be eliminated^ for example, if i*fc,appears to hav(5 little 
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or no relation to the outcome variables by itself, little or no relation 
to treatment variables, and gives little or no evidence of interacting 
(on a first -order, basis) wifch treatment variables in affecting outcomes. 

X \ . - 

A third>approajch would involve performing a series of multiple 

regression analyses, each o^^which includes the treatment variables in 

' \ ' 

a combination with a small subset of other background variables, in 

* ' \ 

* varying combinations. Those variables with consistently lowf beta weights 
could then be eliminated from further consideration; 

Each of the above methods involves certain drawbacks. In the 
first, however, the primary danger\is one of distortion of the real 
contributions o f the variakes . In tljeX latter two, the major drawback 
is that one may inadvertently "lose^' important information. However, 
it is necessary to select from among th| many variables those which 
are most important, and it is, therefore, recommended that variables 
be screened using a combination of the latter two approaches. 

^ With respect to achievement outcomes, the multiple regression 
analysis should focus on change or ^'growth" scores in student achieve- 
ment, rather than simple post-test outcomes. This recommendation 
is based on recent findings suggesting that traditional techniques (such 
as analyzing post-test scores with pre-test scores "covaried") are 
inadequate in removing bias from quasi-experimental data (cf. Bryk 
and Weisberg, 1975; Lord. 1967; Campbell and Erlebacher, 1970), 
While analyses based on change scores are often avoided because of 
^ their greater unreliability, this is not likely to be a major problem when^ 
the score is based on the classroom as a whole, ^rather than the individual 
student. Change "^scor^ pijigfit also be used to define outcom^ measures 
for non-cognitive variables (teacher and student attitudes), and for some 
measures it might be desirable to analyze both change scores and post- 
test scores, reporting any differences in the results of the two methods 
which might affect the conclusions of the study. 

In surnmary, the second stage of analysis would attempt^to estimate 
the impact on outcomes of the treatment variables related ^to individualized 
or standardized instruction, taking into account other variables related to 
outcome or treatment. . * . ^. 
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3. > Stage 3'^ Predicting Implementation Effects 

" ' * 4/, 

Iri the third stage of the arialysis, the contractor should 
•attempt to estimate the likely tmpactiOf the implementation of a par- 
ticular type of program on a hypothetical classroon:^ with a given 
set of characteristics. 

i ' - « 

A number of sources of data within the study are relevant to this 
task. The first of these is the relationship between the occurrence 
of a gi,ven type of program and otl^? school, community, or classroom 
characteristics. Any systematic r.jslationship between frequency of a 
program {or ''treatment'^ ) and other school or classroom characterise 
tics should be examined very carefully to determine whether the 
relationship is relevant to potential problems in program implementation. 
For example, if a given type of program tends to occuro«ty iA fairly 
small classrooms,, one would w^jit tq examine whethefHli^r^ rmght be 
^ a good intrinsic reason for this» "| j * 

The second part of this task is to examine the effects "orthe in-' 
dividualization/standardizatibn treatment varia-bles separately for 
classrooms and students with different characteristics. At the' 
classroom level, the sample size may not pe^rmit cross -tabulation of 
the results>using mor^, than one ar two backgrouhd variables at a, 
time. However, each of the variables found to be important a{: earlier 
stages of the analysis should be exa^ned with the goal of establishing 
estimates of treatment effects within different levels of that variable. 
Thd results of these analyses should be interpreted, carefully, keeping - 
in mind the likelihpod of chance variations in means^ Confidence 
estimates should be provided for each of the .means or regression 
weights calculated in this stage. The overall goal should be to assess - 
wHe|her, on the one hand, the treatnient variables appear to exert a > 
consistent effect which is Substantially independent of other process 
or background variables; or on the other hand, the effect of the major f 
^i^eatment variables is substantially different in classrooms with differ- 
ent characteristics. The possibility of "cross-over'* interactions - ^ 
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(in yhich treatment variables exert opposite effect's und^r different 
. conditions) sV^ould^be especially examined, since this for:m of interaction 
•has substantial policy ^•eleWnc^e. 



^ The multiple regression analysis performed in Stage 2 will provide 
some information relevant to Stage 3 questions. However, multiple re- 
gression analysis has Certain limitations in its ability to adequately ad- 
just for biases produced by other variables. Thus the analysis should 
be supplemented by other techniques which approach the data so,mewhat 
differently. ... 

; One such approach might involve the use of a form of residual 
■^^nalysis, in which one would attempt to construct a mathenaatical 
model relating student growth rates (change scores) to classroom 
•characteristics, and then compare th^ residual or *^added-on" effects 
of the major tr^eatment variables to these baseline effects. Th« math- 
emcitical model its,elf may be based on a regression analysis, on 
multidimensional scaling of classrpoms with respe^jt to background 
characteristics, or on one on more o|^er methods. ^ 

In view of the important policy questions which'underlie ttie pro- 
posed research, it is pgfxticularly desirable to addre,ss some of the pro- 
blems related to implementation of the research findings. It is, of little 
value to estimate tl?e impact of hypothetical curricular changes in schools 
which are likely to be unable or unwilling to make thes^ cJbgnges. Fo-r 

example, some communities or schools may have a strong cultural or ^ 

> >.* < - 

ideological commitment to certain approaches. Thus, the results of a 

study on curriculum effects may be quite irrelevant to th6m, since they 

'cduld only with great difficulty be persuaded to adopt it.- 

Moreover, tlie^asis on which a given type of program has been 
sele'cted may be system^ttically i* elated to background and contextual 
variables which are also related to outcomes. Thus, the effects of these 
variables will be confounded with those l^f the treatment. The selection 
process may also interact with the effectiveness of the treatment. For 
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example, the apparent effectiveness of a program during an evaluation 
may be related to the fact that it was selected by those who most need 
or want it. When imposed on If^s willing participants, the program may 
' prove quite ineffective. ' 

However, there may be a^:^subset of classrooms for which the choice 

^ of curriculum is based on factors relatively unrelated to outcomes, and 

appears susceptible to change. For example, the choice may involve 

limited knowledge of alternatives or represent a tradition which has 

b^en considered very little in recent times. Such a subset would have 

two major advantages for analysis. First, from the standpoint of ex- - 

t^^rnal ^validity, sux:h classrooms may be particularly susceptible to be- 

in'g infi uenced to alter existing policy in the face of persuasive evidence 

! , ^ - 

on program effectiveness. Second, the selection process may have little 

bearing on program effectiveness, since programs were not chosen on 
thi basis of strong preferences. Thus, we are suggesting that devoting 
some attention to the process^ by which curricula are selected may re- 
veal a subset of classes Yd?* whom unbiased estimation of treatment ef- 
feet is both appropriate^nd useful for, public policy purposes. 

' Unfortunately, the criteria for selection of such a subset are dif- 
ficiklt to specify in advance/ Ho.\Yever, as a part of the analysis at Stage 
3, an attempt should be made to identify a subset of classrooms for which 
pro.gram selection appears to be unrelated to background characteristics 
that'^might afffect outcome, and in which curricular change seems quite 
feasible. 



A decision as to the precise nature of^tjie criteria to be used in 
selecting this subsample might be based on»l) the correlations between 
type of program and background characteristic^ found in Stage 1 of the 
analysis; 2) information obtained from principals and teachers regarding 
the range of curricular materials available a^ the basis for selection, . 
3) judgements by field personnel based on observation in the various 
schoojl settings. An attempt would then be nnade to estimate the probable 
impact of program changes»ior these school^. ' , , 
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4, \ Descriptive Statistics 

-5- In addition to the analytic procedures described abovre, the 

contractor should provide a full range of descriptive statistics, Descrip 
tive statistics are those methods that are used to ^summarize the data 
that hasjfeeen collected, but which do not involve statistical inference. 
These methods will include the following: J 

• Frequency Distributions- ^ 

• * Measures of Central Tendency 

• Measures of Variability 

• Cross -tabulations 

Frequency distributions will show the type and shape of. the distri- 
butions, and will be used to determine the type of statistics to be used ^ 
in the analyses of the relationshi^js of variables. The measurers of cen- 
tral tendencies will be used to construct profiles of the comrriunifeies, 
schools, and of the sample of teachers, student*s and classroopis who 
will participate in the study. Measures of variability will incJiide the 
range and standard deviation and will also be used in the establish- 
ment of the profiles. Crosstabs will show the relationship of the 
variables in the study to one another. 

5. Derived Variables 

Many of the most interesting and potentially important var- 
iables in the study may not be available in the form 6f direct faw scores. 
Thus an important part of data analysis is to derive indices and statis- 
tical measures that reflect important independent or outcome variables. 
Potentially, the number of derived variables is literally staggering. 

However, only a relatively small number have great a priori , interest. 

> 

We will list a few of these here, and indicate how indices might be 
constructed. 

a. Locus of Control > 

Each item of the Teacher Locu^s of Control scale is 
keyed either, toward student or teacher attributions for success or 
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fiilure. That is, each itehi ascribes success (failure) to something 
about the student^ or sornething about the teacher/ Derived scores • 
frpm^hese scales consist of the following: (J) summed attribution 
to teacher, which can range from 0 to 24 summed apross the eight 
teacher items, (2) summed attribution to student, which can also 
range from 0 to 24, (3) net attribution to teacher (student), . thfe dif- 
ference between (1) and, (2). This latter index is of particular in- 
terest, since it reflects the teacher's tendency to assign responsi- 
bility for success or failure differentially to students or to the 
teacher. Scoring for specific items is included in Appendix B. 

b. Student ^Activity Log 

if 

This instrument provid'es a wealth of data on the 
classroom activities of individual students with respect to each of 
a large set of objectives which have been individually defined^ f6r a 
particular classroom. It provides essentially the same information 
that would be pr.ovided by a criterion-referenced test, with additional 
information on the instructional techniques associated with attainment 
of a particular objective. Many of the variables' and indices provided 
by the log will be ^'derived variables" in the sense that some prelimi- 
nary data analyses must be performed to provide the scores which.- 
are of primary interest. For example, the degree *to,.^4iich ratfe^ is 
individualized can be indexed as follows: first, those objective |^hich 
most or all students in the classroom have worked on would be identi- 
fied. (It is necessary to eliminate objectives not prescribed for most 
students in the class so that the index will not tfe'^confounded with dif- 
ferences in content). For this subset of objectives, the Student Actir 
vity Log provides three separate measures which can be used to ijndex 
rate: the date on which a student begins work pn,;^' objective, the 
date' on which a student completes an objective, .and the. tptal number 
of hours spent working on that objective. To- th^ extent that the teache 
is employing individualized instruction by varying rates, there should, 
be wide variation in any or all these measures across students, for 
each objective. Thus individualization of rate can be indexed by 
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computing the between- student variance fo r ea rch pf these measures 
for each objective, and averaging across objectives. For starting 
dates, the analysis would begin by defining the earliest date at which 
any student begaii work on a given objective as '*Day'l^*' and would 
assign a "scerjl'* to every other student on the basis of how many days 
after this date he or she is recprded as having begun'work on this 
objective. To the extent that these starting dates vary across students 
the teacher is assigning new objectives at an individual or (subgroup) 
level. A similar procedure could be used to index rate in terms of 
completion dates, total elapsed time, [(completion date)- (starting date)] 
and total number of hours elapsed. -~ 

Individualization of sequence can be indexed by rank ordering 
the set of objectives for each student according to when hfi-be gins work 
on the objective. To the extert^ that the teacher is individualizing the 
sequence of instructional Objectives, these"Tahk orders wilLdiffer ftom 
one student to another. T lus the average rank^order correlations 



(Rho), averaged across stidents and objectives, would serve as a use- 
ful index of standardiii^atioi vs. individualization. 

With respect to content , a simple and useful index might be con- 
structed by examining the matrix of students objectives, in which the 
rows represent'students who have been in a tten d an ce throughout the 
entire record-keeping period and the columns represent objectives 
on which at leasjfc some students have worked... To the extent that the 
teacher "standardizes" the assignment of objectives, this matrix will 
tend to b-e "filled^^ -- that is, each student will be recorded, as having 
spent at least some time on every objective. To the extent that this 
is not the case, then, it can be said that the teacher is individualizing 
content. Thus the proportion of colTs in the S^l^dent objective matrix 
which are filled could be used as a rough index of standardization. 

Unfortunately, this index yould be distor-ted-to_sorae- extent by 
the direction in which individualization occurred. That is, if a teacher 
^'assigned an additicnal objective to one or two students in the class, 
the matrix wonld gain more ♦empty cells than if the teacher failed to 
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assign an objective ta bne or two students. Thus a more accurate index 
not subject to such distortion would be provdded by computing an ^4nter- 
action" score, repre^<|nting the degree to which cell values in the matrix 
d'epart from theoretical, Values bas.ed on row and column totals. (This 
index would have the additional adva-ntage of controlling for rate dif- 
ferences). The logic is much the same as the logic underlying chi- ' 
• square, the difference Toeing that the purpose is to derive a meaningful 
descriptive index of indi;yidjualization/standardizatioji f rom the data, 
rather than to test a hyp^pthesis of contingency. ; 

Much the same' approach can be used to derive indices for 
the other five variables.^ However, in these cases, the matrices would 
include columns representing each of the possible categories of, for 
example, teacher behavior. To the extent.that the teacher behaves 
similarly toward all students working' on a given objective, the all 
values would be completely predictable from row and cplumn totals. 
Departures from such predictability, then, would index individuali- 
' zation of teacher behavior. These, indices woul<f be computed sepa- 
rately for each obje,ctive, weighted according to their possible^-^ange 
on that oTDjective, and averaged across objectives to provide an over- 
all index of individualization^vith' respect to each dimension. 

\ 6. Data Conversion and Editing 

The purpose of this function is to transform the raw data 
that comes in from the field into machine-reg-dable form and to provide 
data editing atgi validity checking to ensure that a verified and accurate 
data* base is established. Instruments should be set up so that key 
punching can be dOtne with a minimum of manual editing. Statistical 
quality controls should , be used to ensure that the data is transformed 
properly. In addition to the detection of errors in the data t«*ansfoi*ma- 
tion process, the computer should be used to determine which data are 
missing, which answers are invalid 'or inconsistent .and which skip pat- 
terns have not been observed. Data items should be checked fbr errors, 
such a$ out of range, out of field, illegal character, mis'sing values or 
combinations of data items. Procedures should be established for the 
correction of errors and the foUofv-up to acquire missing data and cor- 
rect errprs. ' 
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IV. STUDY ADMINISTRATION AND IMPLEMENTATION 



A. OVERALL MANAGEMENT AND STAFFING REQUIREMENTS. \ 

" \ 

The management and staffing pattern for the study should make 
use of a diverse group of individuals who represent many fields of ex- 
pertis.e and levels of experience. It is desi^-able to assemble a staff 
which is both competent in specific disciplines such as education, 
psychology and sociology, and sensitive to human interaction in the 
learning and.helping processes. In addition to such divergence of orien- 
tation an(^ ejq>ertise, the study team should be made, up of people from 
varied ethnic groups in order^to foster obtaining differential perspec- 
tives from those ethnic groups served by compensatory education 
programs. 

Exhibit IV-1: Management Plap illustrates the lines of authority* 
for project management. * 4 

B. STAFE RESPONSIBILITIES AND QUALIFICATIONS 

Key staff positions, areas of .responsibility and duties are listed 
below. Project manloading and staffing level information is provided 
in Exhibit IV -2. > ■ . . . ^ . 

1. Project Technical Director a * ' . 

t * ^ 

^ , . # Has prime responsibility for the technical direction of 

^ * the project. - 

\ • Approves the methodological procedures related to. 
\ sampling, ,data collection, instrumentation and data 
analysis. ^ . 

Reviews and, approves all study products and reports 
\ , (quality control function).-^', * 

Interprets data, writes and makes policy recommenda- 
tions for final report. 
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• Guides and supervises^the development of the final* 

repo*rt. " ' 

. ^ / ' . ' • 

. • Serves as^^rime liason betWee?n the cot^ractor an^ * . 

^ : • ^ ^- ^ ^ . ; ^ -v . ' 

#^ , Se^s qualifications and approves the hiring of all per- 

sonnel^. ^ - - • ' > , ' : ' - ■ 

" " \ ' - ' ' , V . 

• ProVideg'rethni.cal input te^Tnojithly repor{?||V-' ; ' - 

Project Manager ' 1 ; ' ^' ^ * 

• ' Has prime xnanagem'enf respon^ijbiiliti'^s for project. 

• /• Recruits/ hires and fires staffi , ' ' * • * 

• v>Assi^ns' staff , responsibilities and duties/ 

' " *" * "iV ' ' ^ ' * 

• Sets schedules^ aeVe:lops procedures for meetingr^ 

• ■ ' " i ' ^ ' ' * *^ . ' ' . ' 

critical project deadlines. . ' * ' r ^ 

^ / ' 

• Operatipnalizes ^nd refines the data collection 

^ plan^.and «ets' sd^e<iules.* -.j- - '"^"^ 

• " MQnitoi;]^ adhi6r6n.ee to project tiitie.line. - V 



Has prime responsibility for budgetaTy'mcLtter's* 
Approve is all project expendituire^r 



Writes monthly, pirogjdg^^'^rep . T 

Deputy Proj%t:t -Manager " / ' r 

Ass.ijyte^^^^'^i'ojecf Manager and,pter|orms duties as 
assigned, by thA|Project'Man4ger,.. / • . 

m-'' Coordinate?^ a^l day-to-day operations/ 

f Directs sfc^iff activities and coordinates staff functions. 

• Serves as liaison be^f^een 'contractor amd scfhool 

^ personnel y/hen Field SiK^ei^s^-^'^^'in the fields 

/ ^ ^ ' ^ ^ . ' • ^ * 

• Facilitates regular staff meetings. 

• Writes all, major correspondence to. schools and ' * 
supervises mailings. , ^ ' . , 



Supervises all data collection personnel. 

• /, Mppitqrs adherence to the qualitative and quanti- 

tative specifications^, of the data collection plan. 

• Develops the logistical plans for field J^ff. 

• /Develops data collection staff^f raining program* 

and manual; supervises training* of field sliaff. 

• Works closely with Measuremeat'and Instrt\ment 
Specialist' and identifies practical problems 
associated with the instruments. 

Sampling and Data Analysis- Supervisor ' 

• Ha^prime responsibility for directing all data 
analysis and sa[mpling procedures. ^ 

• . Interprets darta and -helps write the final report. 

• Has prime responsibility for writing the. interim 
report, 

• Specifies and refines procedures for sample selection 
and selects sample. * ' . ^ 

• . Creates sampling matrix and supervises the filling of 

sample cells. 

• Performs statistical analyses. 

• Assigns responsibilities and supervises activities of . 
computer programmer, research assistants and key 
punchers. 

Compute r^.Prograimmer . , ^ , . 

• * Programs data and runs programs as_<ietermined by 

the Sampling and Data Analysis Supervisor. " ; 

Data Analysis feesearch Assistants (3) 

• Edits, codes and conducts validity checks on data. 

• Tabulates and summarizes data under the direction of 
the Sampling -and Data Analysis Supervisor. 



7. Field Supervisors (2) . / . 

• Coordinates and conducts .telepfione screening of 
: * teachers during sairipling sjtage. 

• Directly supervises, the activities of the field data col- 
- lection staff (one is in charge of staff \;?orking in the 

Eastern part of the ,U. S. and the 'other is in^charge of 
those working in the Western part of the U. S. ). 

' . . • Makes unannounced visits to classrooms where data 
1 . is being collected to raonitor activities of the field 

^ . staff. (Spends over 75% of time in the field. ) 

• Evaluates performance of field staff and makes recom- 
' mendations for replacements. if needed. 

• Trains field data collection staff. - ^ 

• keviews completed instruments ^'or accuracy and, 
J compl^t ene s s. ' . 

• Regularly reports progress and^pr^ahlems in the - 
field to the Deputy Project Manager. 

• Makes logistical arrangements for field' staff. 
(Works with travel agency. ) 

• Coordinates and conducts telephone screening of 
teachers during sample stage. 

\ ' ' m ' Serves as prime liaison between project and 
school personnel. 

• Tabulates and records responses from Superin- 
tendents, Prinicpals, and Teachers to initial 
inquiries Requesting project participation. 

\ • Makes all follow-up calls to school personnel. 

• Monitors receipt of Student Activity Log and " 
^ makes necessary foll6w-up calls. 
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Field Data Collectors (25)^(5 Alternates) 

• Each makes 4 site^visits to approximately 10 
schools in the sample as scheduled, 

• Administers all study instruments and conducts 
interviews. 

• Trains teachefs in the use of the Student Activity 
Log and helps teachers to determine objectives, 

• Monitors teacher performance in keeping the Student 
Activity Log and makes appropriate recommendations, 

• Conducts classroom observations and completes 
Classroom Observation Instruments,, 

• Reviews all complete^d instruments for errors and ' 
completeness. ^ • ^ 

• Determines and attempts to solve any problems ^ 

f *^ 
associated with particular schools and teachers^ 

• Keep^ ^.ccurate records and reports of all travel 
expenJiitures,. 

ivieasurement and Instrument Specialist 

• Determines and makes necessary revisions in 
all study instrumetiLb, 

• Sets up and coordinates instrument pretest. 

• Writes OMB package, 

• Obtains copies of all study instruments (places orders 
with publishers; has unpublished instruments printed), 

• Writes procedures for administering instruments for 
inclusion in field staff training manual, ^ * 

• Trains Data Collection Supervisor on the administration; 
of instruments, ' . J^->' 



• Consults with Data Collection Supervisor brt 
practical problems relate^ to administration 
of instrument?. • •'-^^ 

Instrument Research Assistant 



• AsLsists with writing the OMB package. 
m Conducts instrument pyetest. 

• Makes necessary revisions in instruments at 
the direction of the Measurement and Instrumerii 
Specialist. 
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C PROJECT TIME UNE \ 

1. Overview and^^Anticipate^d Scheduling 'Problems 

The project has been scheduled iA*:heL gonducted, in. a period 
"of 18 months beginning on Feb, 2, 1976 and ending July 31, 1977. " This 
schedule has been created primarily to be rers.pog;ifi^ve to the constraint 
indicated in the RFP which states that the final report must be completed 
by July, 1977. CRI anticipates that this constraint will b^ a major 

problem to the contractor. i ' ; 

■* ' 

Since there was iao project starting date indicated in the RFP, CRI 
has only been able to estimate a reasonable ti^e period which would 
allow NlE^to decide upon a design, select a contriictor and make the award. 
We allowed five months for this process. Since schools will be closing ' 
in June/ 1976 and 3rd grade students will become 4th grade students in 
Sept. , 19 76, it is not advisable to begin data collection beifore the close 
of the 1975-76 -school year. Therefore, data collection should not begin 
until the 1976-77^J3chool year commences. 

Because the design calls jfor pre-?and-post-testing of students and 
teachers, optimally a full school year would be desirable to allow maxi- 
mum change'to occur. On the other hand, the voluminous amount of 
data necessitated by the study and the time needed to digest the data in 
order to recommend policy appears to actually require no less than six 
months for data analysis and interpretation. . ' 

"Since only eleven months existed between the opening pf school 
(Sept. , 1976) and. July, 1977, a compromise was necessary. Consequently, 
allowing for loss of time due to school start up and holidays, six months 
were allowed for data collection and three months were allowed for data 
analysis and report writing. , • 

It is our deliberated opinion that the compromise we have proposed , 
is feasible ^Jit will' place extraordinary demands on the 'contractor with 
respect to data analysis and final report development. CRI sugg'ests as 
an option that NIE review the possibility of lifting the Ju^y, 1977 
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constraint and report to Congress later in its session in order to allow 
at least five months for data analysis. This would cause the final report 
to be submitted in October, 1977/ " ' 

The compronaise schedule which CRI has developed is detailed in 
Exhibi}; IV. 3: Project Time Line. 
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EXPnBIT IV-3: PROJECT 



Projeet mauiagement 
and' cOw>rdination 



Satnpling procedure 



Instruments and 
material preparation 



C ommunicatlon 
vdth schools 



Logistical planning 



SUff training 



Data collection 



DaU analysis 



1976 
2/2 



■ ■ -J 

T TIME LIB 



12/9 



ia/16 



Meet with NIE reps, in Wash- 
ingtcn JLnd Enalize overall 
research design and metho- 
dology • 



Finalize stafEng plan (make 
necessary changes) 

~A 



2/23 



Orient key 

'project 

sua and 

assign 

areas of 

responsi- 

biUties 



3/1 



13/8 



•13/15 



3/22 



13/29 



J3 



Obtain 
complete 
list of 
districts 
with 

Comp. £d, 
funds 

from SRI 



Reporting 



ERLC 



Select 102 dis- 
Itricts in District 
Survey X and 102 
istricts not in 
[District Survey I 



Prepare letters 
to superinten- 
dents and re* . 
sponse mailers 



Prepare letters 
to principals 
and response 
mailers 



Review and make necessary revisions of all 
study instruments and tests 



Conduct pre! 
newly dev^lc 
revised insti 



Mail letters 
to Supts. of 
204 districts 




> 








Arrange fox 
instrument 
pretest 















Mail letters \ 
pals (maximi 



Train sUff 
for instru- 
ment pre- 
test 



Design sampling frame 
delineate sampling 
procedures 



Analyze responses to superintendent inquiries 
and revise sampling procedures if needed 



2/2 







Prepare 
and submit 
monthly 
progi^ess 
report 




Prppare 
and submit 
monthly 
progress 
report 


' 1 














* 


















12/9 


I2/I6 


2/23 


3/1 


I3/8 


1 I3/I5 


I3/22 




3/29 



12!1 



j3/22 V [3/29 I 



4/5 



12 



14/19 



|4/26' 



Finalize telephone screening 
tt^fl (recruit and hire neces- 
sary personnel) 



5/3 



15/10 



5/17 



I 



eet in 
ashington 
with NIE 
reps to dis- 
cuss OMB 
package 
draft 



S/24 



15/31 





• y , 

Finalize telephone screening 


■ — ■• = — >- 


procedure and screening gmde 



Select 400 potential respondents 
(teachers) and conduct telephone 
screening 



e letters 

cipals 

iponse 



Prepare letters to 
teachers 



isions of all 



jConduct pretest of all 
Inewly developed and 



1 revised instruments 



Revise and duplicate telephone 
s<^reening guide 



Revise study instruments and 
write OMB package draft 



Submit 
draft OMB 
package 
for 

approval 



Mail letters to princi- 
pals (maximum 800} 



Revise and subnUt 
Enal OMB package 
for clearance 



Mail letters to 400 teachers 
recommended by principals 



Train staff 
' for instru- 
n^ftnt pre- 
test. 








> 




Train ataff 
for telephone 
screening 






>- 


■ : : : 



Analyze principal responses to 

]uiry^and revise sampling 
pr oceaOT*,if^ne eded 




Analyze data from telephone 
screening; classify programs 





Prepare 
and submit 
monthly 
progress 
report 




Prepare 
and submit 
monthly 
progress 
report 




^lutetii^ 

OMB 
package- 
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1976 , 
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/ 



4^8 



|7/§. 



17/12 



17/19 17/26 (18/2 |8/9 



ProJ ect man&geme nt 
'and coordination 



Sampling procji^darei 



Ia»tnixn^nt« and 
rnateri'al px;cparati'on 



' Revle^SLaualysls of responses to 
telephone screening procedure 
and select finalfSample of 
250 classToofns 



• Order published 
instrxixnonts from 
publisher 



C onununications 
with schools 



Logistical planning 



Make logisticaL 
ments for D.C, 1 (Dati 
Collection Pretest) 
through travel agent 



SUff training 



Data collection 



Data anal /sis 



Reporting 



Analyze data from telephone 
screening; classify programs 



Prepare . 
and submit 
report on 
sample 
selection- 



^Pxepare 
and submit 
monthly 
progress 
report 



\7/Z6 ^ 



A = Tochers mall 'to ^ 6/7 
project student activity 
log each Friday 



l6/U 



16/21 , 16^/28 



1 7/5 



17/12 



17/19 



8/2 



1 8/9 
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)JECT TIME LINE (Cont'd) 



. 18/9 



18/16 |8/23 



|8/30 . [9/6 . j9/U j9/20 j9/27 |10/4 - >^jlO/l 1 |10/18 \ | 



10/25 



{Recruit an^ Mre any 
additional data collec- 
tion personnel needed 



Meet in 
Washington 
with NIE 
project 
nnonitor 



Prepare letters to 
respondents (princi- 
pals and teachers 
selected for sample) 







Prepare 


>- 


Print unpublished • 




notification 




study instruments 




of D.C. 2 






visits 







Notify 
teachers 
and princi- 
pals selec* 
ted for 
sample 
and mail 
question- 
naires 




^ ^ 

1* 


' ■ ^ ; 



Ucal arrange'-* 
).C. I (Dat* 
Pttttst) 
vel agent 


t 






Make logistioa} 
arrangements for 
D.C, 2 visits 
through travel agent 











> 


Train data collection 
personnel for pretest 
DX.' 1 visits 






■ >■ 



Conduct D.C. 1: DaU Collection 
Pretest visits to 230 classrooms^ 
(2 dkys/classrcom) 



A . 



Prepare 
and submit 
monthly 
progress 
report 



Revise and refine data analysis 
j^lan„and procedures 



Prepare 
and submit 
mtonthly 
progress 
report 



Prepare 

and submit 
monthly 
progress 
r«port 



8/9 



f8/16 



18/23 



18/30 



19/6 



19/13 



19/20 



19/27 



110/4 



Uo/11 I10/I8 '10/25 
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1976 



ll/l^^ |ll/8 |11/15 |U/22 '111/29 ji2/6 jl2/13 |12/20 j 



12/27 



1977 
|l/3 



Project managemeot 
zxid coordina^tion 



SampUng procedures 



Instruments and 
niaterial preparation 



C ommunications 
with schools 



logistical planning 



SUff training 



Data collection 



Data analysis 



Reporting 



Prepare 
notifica- 
tion to 
schools of 
D.C. 3 
visits 



MaU notia 
cation of 
D.C. 2 visit 



Mail^oti- 
flcation to 
schools of 
D.C. 3 
visits ' 



Make logistical 
arrangements for 
D. C. 3 visits 
tlirough tra^l agent 



Train data collection 
personnel for D.C. 2 
classroom observation 



Conduct D.C. 2: Classrdom observation 
data collection (250 classrooms) (2 days/ 
classroom) 



£dit data and ru^^- ^ 
validity checks J 



Conduct Stage I data analysis procedures 



Train 
sUff for^ 
D.C. 3 
classroo] 
observa**^ 
tion 



Edit data and run 
> vaUdlty checks 



Prepare 

and subnnit 
monthly 
progress 
report 



Prepare 
and submit 
monthly 
progress 

report 



A 3 .T«aeh«rs mail to 
project student activity 
O log each Friday 
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112/13 



112/20 
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OJECT TIME LINE (ContM) 



A* 



1977 



112/27 



[1/3 ^ [r/10 jl/17. p|/24 



11/31 



12/7 



12/14 12/21 



j2/21 j2/28 j3/7 [^3/14 [^ 



Meet in 
Wafhing- 

tofi with 
prtoje'ct 
monitor 



,Pr«p*re 

notiifca- 
tion to 
fchoolff of 
D, c: 4 * 
vi»it» * 



Prepare 
materials 

for meet- 
ing with 
NIE 





Mail noti- 
fication to 
schools of 
D. C. 4 
visits 




— >- 






Make logistical 
arrangements for 
D.C. 4 visits 
through travel agent 



Make 






arrange- 






ments for 






Washington 




— >- 


meeting 







^— 


Train 
sUff for 
D,C, 3 
classroom 
observa- 
tion 


1 ■ ■ 


1 




Train 
sUff for 

D. C. 4 


•> : ' 




J 


i 
1 


>- 


post-test 

data col- 
lection 







Conduct D. C. 3: Classroom observation 
data collection (250 claLssrooms) (2 days/ 
classroom) 


> 


Cc<-«iduct D. C. 4: Data collection i 
post-test (250 classrooms) | 





— > 







ta and run 
chscks 



Begin Stage 2 data analysis procedures 



A 

— 1— 



Edit data and run ^ . . ^ ^ , , , . 

validity checks -*<Continue Stage 2 data analysis procedthres 



Prepare 
aad submit 

monthly 




Submit 
Inte rim 
Report 


^ ^ >■ 


Prepare 
and sui}mit 
monthly 
progress 

report 


>- 


progress 
rsport 


> 





















I2/I4 ' 












' ll2/27 




li/io 


11/17 


ll/24 ' 


ll/31 


I2/7 


I2/2I 


I2/28 


I3/7 


I3/I4 
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13/28 



14/4 



14/11 



' EXHIBIT IV-3: >PROJECT 'TIME LI] 

14/18 14/25 . 1^/2 * 15/9 > |Sl/l6 



Project manmgement 
and coordination 



Sampling px'ocedures 



ln«tmxnent« and * 
material preparation 



C ommxinicat ions 
with schools 



Logistical planning 



Staff training 



Data collection 



DaU analysis 



Reporting 



Meet in 
Washing-* 
ton with 
project 
monitor 



■4 



-I- 



Prepate 
materials 

for meet- 
ing with 



Prepare final report draft and 
oral presentation 



Pr«par« " 

thai^ you !- 
letters to | 
schools 



Mail thank 
you letters 
to schools 



Collect 

complete 

copy of 

student 

activity 

log 



Edit data and run 
validity checks 



Conduct and complete Stages 2 and 3 data analysis procedun 



Prepare 
and submit 
monthly 
progfress 
report 
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3/21 



13/28 



|4/4 



4/11 14/18 14/25 1572 



|5/9 ' 15/16 
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SCT TIME LINE, .{Cont'd)./" 



I6/13' 



16720 



16/27 



H7/4 



Give orarl 
final report 
briejfing In 
Washington 



|7/ri ^ 



|7/I8 ' >?/25 



Prepare 
test 
results 
tc send to 
schools 







Mail test 






results to 


■ - •* * • 


schools 



• -1 


Make 




'—^ — ^ '■>- 


arrange<- 
ments for 






Washington 
meeting 
















f 

• 










- \ 




• 








■ 







iai^a^l7si;8 procedu]^e8 



— — — -V 


Submit 
final 
report 
draft 




r « ' ' 





-0' 
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16/20 




l7/H 



17/18 



'1 




D. PROJECT REPORTING ^ . , , . 

-•Four major types of reports are, to beiprovided by tKie contractor 

tp *NIE. A description of the essentiaLxont^ent of these repojjts is pro- ] 

V ' . * * * 

vided^below: ,^ ^ , 

1. . Monthly Progress Reports ' ^ 

At the end of- each tnonth '{except those wlfen other reports 
are due) the contractor shpuld subrmt to NIE a progress report delin- 
^eating, in letter fo'rm, the activities caoducted during that month. 
^This report shoifld cover the tasks tha^ were Accomplished and any 
problems or' difficulties encountered. , - , \ 

2. Task Products * : , 

9 , j^^sk products resAJlt from the completion of a major study 

task«.^'-!rhere are two major task products oYthis stCidy, 

* a. Final Sample Selection - This report should include 

. ^ the final sample of classrooms selected for study, 

1 • ' Prelixninary descriptive itifprmation on the classrooms 

'I " and the completed sampling matrix should be inc5luded. 

b. ' OMB Package - All of. the instrumeiits that are to be * 
* used in the study, justifications for their use, item 
lustifications for newly created^iO^ Revised instruments, 
and instr^iment administration information should be 
• . o compiled into a report that is submitted tp the Office 

of Management and Budget (OMB) for approval. The ^ 
0M6 package should meet the specifications designed 
^' ^ by the OMB. • 't* — 

3. Interim Report . ♦ 

■ *• < intef'im report is to be compiled an^d submitted to NIlJ. 

' This repe.rT should cover the results of Stage I of the data analysis. ^ 
. Specifically, the report should include pre^liminafy empirically derived 
definition(s) of individualized instruction.^ It should also provide pre- \ 
liminary program treatment clusters and descriptions of their \ 
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^ characteristics. T^ie report shduld be considered '^preliminary'' as 
the findiri^s in these areas may chanjge as^^the study progresses and 
more data is collected, 

4. Final Report • - , 

The policy orientation of tl>is research effort means that the 
final report should contain guidelines and recommendations regarding 
desirable and undesirable instructional practicesf. Tliese recommenda,- 
^ tions should be'^seid on sound research findings and analytical tech- * 
niqiies. They also s^hould be pragmatic, realistic; and relevant to 
existing program contraints anjj practices. . In short, the/ should be 
feasible to implement in the near future, and have'a reasonably high 
probability of success in terms of effecting measurable g^ns in student 
performance levels. , Such a report would, therefore, have to describe, 
in specific terms the kinds of educational practices and policies that 
actually influence student performance as well as the factors that must 
be cdnside!red in order to instituter these practices and policies. 

KT ^11 likelihood, the final report of this res.earch effort will con- 



tain well d6cumented scenarios of how to develop, impFement, operate, 
^and monitor instructio'na/programs in a way that avoid common pitfalls 
and wTiich provides a means for evaluating the extent to which 'each kind* 
of program has been operationalized, (i. e. , in terms of its key compo- 
nents) and achieved its goals. Since it is unlikely that one kind of program 
works ''best'* fcTr all kirids of situations. or students, the final report 
shduld addressHhe question Which kinds of practices are likely to be 
most successful in which kinds of contexts?* 

The final report should be wrttten in three separate volumes as 
follows:- - 5 . - ' 

Volume I: Executive. Sunnmary% - ' 

A brief overview of th^e .entire study forlh^ executive -^-^i^iJ 
decision maker and general public. 
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Volume 11: ' Study Design ' . • * . ; . . ' 

"A description of the 'Study conceptualization, method- 
> ology and instruments* 

Valurhe III: Findings and Recommendatiorns * ' ^ * ^ 

A. Empirically derived definition's) of individu- 
' alization-standardization. 

B. Pragram clusters and characteristics. 

J c] Impact of individualization - standi r dizat ion qa 

compensatory education stu4ents and teachers. 
Effective classroom practices. 

D. Critical factors and p^rocesses that influence . 
, the effective^iess ^nd extent of individualization. 

E. Policy Recommendations' Regarding: 

U Effective practices which can and should 
^ ^ • be, adopted. , 

2. ^ Adoption and implementation concerns and^ 
procedures* ^fc^- . 

' - f 3. Evaluation and monitoring concerns and 

procedures* ^^,,13^^' 
* ^ .r 4. Implications for Federal, State and Local 

" Compensatory Educatipn Guidelines. 

5. Implications for Federal, State and Local 
. spending. 

F. Reporting Schedule ^ - 

Reporting due dates are as^ follows: 

- " ' Monthly Progress Reports - End of each month 

* ^ ' except May, 1976; 

• ' . ^ * Juiie, 1976; Jan. , 19 77; 

"^'^^^ . ' • - June, 1977; and July, 1977 

* * • * 
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Task Products ; ^ * « , 

* * 

OMB Package , May 31, 1976 
Final Sample Selection June 30, 1976 

foterim Report S Jan. 31, 1977 

Final Report Draft ' ' June 17, 1977; 

c 

Final Report (150 copies) July 31, 1977 
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ESTIMATED BUDGET 



• - - 

The following budget is intended to provide NIE witH%p j^^^mate of 
what it would cost to conduct the study. Since the contractor has not been 
selected, the actual costs cannofe be calculated. ,The costs included in 
this bi^dget have been baaed* oa actual CRI rates (Direct Labor} S^ayroU 
Related Expenses, Overhead, etc.). Therefore, the attached budget 
represents projected cost estimates of CRI. - ' , > 



Budget Summary^ 



Reference 



2. 



3. 
4. 
5. 
6. 



Direct 
Labor 

Category No. 1 
Category No. 2 
Category No. 3 
Category No. 4 
Typing Support 

Payroll related 
expense @ 27% 



Estimated 
Hours 

6, 238 
5,718 
32, 927 
4, 679 
6, 238 



• Rate/ 
Hour 

$ 14, 12 ^ 
9.22 
6. 92 
4. 90 
4.10' 



Total Direct Labor; 



^Estimated 
♦Costfs) 

$'88,081 
, 52,720 
227,855 
,22, 927 
- ■25, 5 96 $, 



Tdlal Travel 

Total Consultants 

Other Dire'ctCosts, 

Overhead vihcluding43 & A) 
76. 6% of Total Direct Qost 



Fee 



• 'Total Estimateti Cost; 



;^417,'179 

112, 638 
529,817 
. 194,225 
25,000 
36, 000 

600,-576 
.L,-3-8A,.6lJ 



114,2,31 

Total Estimated Cost and Fee: $. 1,498, 849 
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DIRECT LABOR • • ' 

Assoiming a start date of'February 1, 1976, and an ending date of^July 
31/1977, Direct Labor fat the project was estimated ^s follows: 
$417, 179 ^ . , • 



DIRECT Labor in man hours 

Category Category Category, Category Typi 
No> 1 No, 2 No, 3 No, 4 > Supp 



Project Manager : 3, 119*, 

Deputy Project Manager 
Project Technical Director 3, 119 
Sampling & Data Analysis ' 

^Sj^ervisor 
Computer Programmer 
Data Analysis Research 

Assistants (3) 
Field Supervisors (2) 
Field Data Collector^ (25) 

(5 alternates) ^ 
Measurement & Instrument ^. 
Specialist ^ ° 

liistrurrient Research ^ • 

Assistant 
Typist • 



3, 119 
1,906 



693 



Total Man Hours: 



Mkn Months (divided by 
173.3): 

■ •« • 

: PAYROLL RELATED EXPENSE 



,6,238 

"3.6 



5,718 



33 



433 

3, 813 
28, 161 

520 
32, 927 
190 



4, 679 



4,679 



27 



6,23 
6,23 



Payroll Related Expense refers to such expenses as vacation, holiday, 
sick leave, payroll taxes, group insurance, etc. / 

^ $112>38 



TRAVEL 



A. Field Work 



(.1) 108 Round- Trip Los Aijgeles 
to various "national Ideations 
@ $300 .average/trip 

♦ • . ^ 

(2) 2997 Days Per Diertj ® 
$40 /Day . , 

(3) 2295 Days Ground Transpor- 
tation @ $15 /Day 

I - • ■ lV-20 



$ 32,400 ' 
119,880 
34,425 



$186,705 
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B. LA /DC Project Coordination 

(1) 2 Persons 8 Round Trip each 

' ' LA /DC @ $370/Round Tpp $ 5, 920 

(2) 32 Days Per Diem @ $40/Day 1, 280 ' 

('3) Ground Trar\sportation @ ^ 

$10 /Day. - 320 7,520 

Total Travel: $194,225 

CONSULTANTS 

250 Teachers (one per school) to be paid $100 honorarium 

each one time " ; $ 25,000 

OTHER DIRECT COSTS " • ' 



A. Computer Time & Keypunch , $ 12,.000 
Bv " Communications 

(1) ' Long Distance Telephone \% 3,600 

(2) Ppstage and Shipping 1,800 5,400 

— ' J 

C. Reproduction 

(1) Xerox - ^ $ 2,r00 

(2) FinaLReport Printing 5,000 ' 7,700 



D. Supplies ' 1,800 

* * •* 

E. Tests and Instruments (Approximately 37, 500), 

and Associated Training Fees ' " . 9» 000 

Total Other Direct Costs: $ . ,35^000 

• Total Direct Cost: , ' $ 784,042 
^OVERHEAD (Including G & A) 



Overhead (incl^uding G & A ) contains traditional overhead 
^expenses as overhead salaries, ovei^head travel, rent, 
utilities, etc, , * 

$ G00,m4> 

/ * ' ^ * Total Estimated Cost: ^$ 1,384,618 

FEE@/0825 ^ $ 114,231 



/ 



Total Estiniated Cost ' ^ 
and Fee: v * $ 41, 498,849^ 
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V. UTILIZATION OF THE FINAL REPORT 



TARGET AUDIENCE FOR THE FINAL REPORT 



The policy na^ture.of the proposed study dictates that the final 
report should.be oriented towards polidy makers at the federal, state, 
district and school levels as well as curriculum develop.ers in the 
private and public sect6Vs, Additionally, the study, is likely to be of ^ 
interest to edticational researchers in terms of study procedures and 
methodology. While policy makers at all levels have concerns 
related to recornmended educational practices, they each will probably 
^ view these recommendations from different perspectives. The nature 
of these target audiences.* particular concerns and how the report 

should satisfy their needs is described below. 

■> 

1* . Fedgr^l Level Policy Makers 

Policy makers at the Federal level, include Congressmen, 
National Institute of Education and Office of Education program 
adm*inistratorsr These individuals are likely to be particularly con- 
cerned with implications related to changing and/ar adding to Federal 
Compensatqry Educatibn Guideline s^and federal spending* 

To meet Federal policy makers concerns, CRI has recornmended 
that the final report include^ specific sections which address policy ' 
questions regarding* Federal guidelines and spending questions such as: 

• . Should individualized injfet ruction be mandated? 

"What source and level of funding should be associated 
w.ith individualized instruction ?^ 

'Considering the differences in various contextual settings, 
can broad balsed , guidelines which cut across these contexts 
be develpped^ and if so, what should they be? 

If mandated, how could compliance with guidelinesi concern- 
ing individualization be moniiored? ' • 
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2# State Level Poli6y Makers 

^ - State level pojlicy makers include state legislators, boands 

of educatipn and educational agency program administrators. These 
individuals are likely to Aave the same concerns ' a s t he fe^e'ral level ■ ^ 
policy makers but from a state perspective. It is basically the * ^ 

responsibility of the states to operationatiz"e^Title I and other feattegor- 
ical programs-guidelines and monitor cort^pliAnce. In addition, theyi 
develop gxii4elines and set spending levels for state-bperated compen^ 
satory education programs. * ' 



To meet the concerns of State level policy makers, CRI has 



recommended-tha^t the final report include specific sections which' 
address policy questions regarding State'guidelines, the operationali- 
zation of Federal guidelines and State^monitoring/evaluation/compliance 
such as: 

. How can state compensatory education programs^ 
_ compliment and enhance Federal programs? — 

• HpW can Federal , guidelines be operationalized ? 

• What seems to be the practical problems in monitoring 
individualized instructional prog rams2 * 

• ^ wfeat demands can be placed on local districts. with respect 

to individualization/gtandardization? 

, 2* district and School Level Policy Makers 



T-his group of policy makers ^nj^lude local boards of . 
education, local educational a"gency administrators (especially District 
Compensatory. Education Directors) and schop^l principals. These in- ^ 
dividuals are-likely to be most concerned with implementation /adoption 
problems and prqceduVes.- • , ' / ^ 

To meet these 'concerns, CRI has recommended that the finaV 
Report include a specific section which addres^es-adopiion/imple- • 
mentation policy questions such as: " - 
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m What practical problems can the District expect ifi imple- 
menting newly ^recommended instructional approaches? • 
What concerns will teacher /parents, students and other 
community residents have? 

• ^ What -level of funding. is required to adequately meet any ^ 

implementation demands? 

! 

• Does it seem likely that the recommended instructional ' . 
approaches will teally increase compensatory education 
students achievement? 

: 'B.. DISSEMINATION/UTILIZATION RECOMMENDATIONS ' ^ 

h . Analysis of the Probl^ems 

'The growing emphasis on accountability of social programs 
has also affected, the way in which social researclji itself is viewed. A 
decade of reports and studies that have/'sat on the shelf* of. government 
offices has led to the deniand that Federally ftinded research reach the 
largest possibly target audience. 

CRI^s recommendations concerning dissemination and utilization 
are liased on* several years experience aS'^a contr.actor responsible both 
.for producing research reports that would be N^idely disseminated and 
utilized^ and for developing systems and materials for dissemination 
to educators dround the country. CRI is thus particularly sensitive to 
the problems of dissemination and utilization of "knowledge in education. 
These r'ecommendations are empirically based on our experience with 
, the problem^*, as well as on* research and the knowledge gained^ from 
conducting a conference for NIE in 1974 on increasing the use of infor- , 
mation about innovative ^or pronriising educational practices'. 

The major reasons for-fche lack of utilizatign of research. istudies 
kffclude: " ' , > . 
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• Ineffective, and undifferentiated presentation of the \ 
^ ^ , information such that potential target audiences cannot 

determine whethenthe study .woul^ be of interest and use* 
to them, 

. • . • Lack of involvem.eht of critical linking agents those 
people who serve as channels of informatiori about 
information for different potential target audiences. 

• ' Lack of an effective, nationwide dissemination system^' in 

education, particularly for educational policy makers and 
program managers. 

The first reason leads to recommendations as to how the 
contractor should be required to develop and organize the final report; 
the s^ond and third lead to actions that NIE should take to facilitate 
disserriination and utilization* 

2.. Presentation and Organization of the Final Report 

In the preceding section, the various policy makers were' 
identified whom^ CRI believes will have a substantial interest in and use 
for the information Yrom the 3tudy. CRI would repommend that the 
contractor Be required to write specific chapters' in the findings and 
recommendations - volumes which can be pulled out as separate 
documents for wider dis.semination. The most effective format for 
communication with policy makers would be to have 'a section or 
chapter, specifically titled »*For Federal Education Policy Makers»\ 

The findings and recommendations should be in a question and answ 
format, such a3 '^WTiat are the costs associated with effective individ- 
ualized instruction programs'?" It is critical to ask the contractor to 
develop docoVnents ,th^t specifically address the various target audiences. 
NIE -should not assume that 'the general executive summary volume will 
in itself cpmrnunijca^^'dir ectly to the different types of concerns, or 
*that ''s.oitiehow", after the report is completed, some of NIE staff will 
ha:Ve either the time or the ability to develop these materials. The , ' 



requirement that the contractor develop effective, differentiated 
materials for reaching a broad and differentiated target audience, has 
not been\ a^^ommon practice in Federal coiitracting; it is well within 
the capability, of the contractor, and would 'further serve to ensure 
that the analysis itself address a variety of policy issues and questions. 

The executive summary itself we Jsee as primarily a document 
'tqrl^'E'^d'CongYhS^,' addressing their concern's and presenting an 
overall view of the work done. As such it wouFd nof contain extensive 
technical discussion of the data from the different perspectives of 
State and local program planners, educational researchers, etc., 

3i Involvement of Linking Agents 

6ne major mistake, made over and over again by those 
responsible for information dissemination, has been to focus all of 
their attention on the written document, ignoring the need for person- 
to-person contact. Research on information utilization, whether the 
user is a highly t'rained researcher, or a local superintendent of 
S'chaols, has shown'that people s*till rely on wbrd-of-mouth recom- 
mendations (Rogers, 1962; Glaser and Taylor, 1969; Shuy, 1973)^. 
The same research ghowsv tffat to this point, formal information 
retrieval systems are used least often in arriving at solutions to 
pressing problems (Garvey and Griffith, 1967). 

' Part of an effective dissemination strategy, therefore, is to 
identify key resource persons and the channels of communication tixey 
influence. . These resource persons iCan become key figures in niaking 
others aware of the report and its contents'. For example, USOE 
Title I administrators for the various, regions are key personal" ^ ^ 
contacts fpr state Title I personhel. Superintendents, a^s reported by 
Shuy, identify Vith professional journals such as Phi Delta Kappan, 
and the publications of the AASA. The editors of these publications, 

who are also involved in yearly copventionjs and- association meetings, 

, «? ' • ' « • 

and have tljus established personall cont-acts, become key linking agents 
for reaching the large target audience of school superintendents^and 
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their staff. So too, do the Title I adrrv^^rators at each state. NIE 
would need to map out the key individuals once their interest in the 
report is raised and they could become effective channels of communi- 
cation to others. ' ' * 

The most effective way to begin involving members of the key- 
target; audiences wouId.be through workshops, possibly held for Federal 
and State Title I administrators, and other national educator-communi- 
cators concerned with imprc^ving educational practices. The medium 
of a workshop is one of the most effective and least expiensive ways 
to initiate dissemination^of information. 

' J, » 

4.. Dissemination Systems 

. As noted earlier, the field of education is so vast, and 
diverse, that no single dissemination system has yet been established 
to which one^can turn and be assured that a given' stu,dy or report will 
be disseminated to pot^ential users. ' ' 

Fortunately, NIE's Division o^ Dissemination and Resources, has ^ 
been involved in sponsoring a^'diverse group of local, state, and 
regional information centei-s and services, in addition to the ERIC 
system. J^nlike ERIC^ these centers have developed strong personal 
networks Jor disseminating information, and together, they reach an 
increasing number of educators and program planners at state and 
local levels. Be^pause thefe systems atf^' centers ar^ very user- 
oriented and responsive, they are actively^^oi^ed in seeking out 
information, and materials to meet user needs, and'^nany transfer 
technical reports intp more initially oisefu I summaries. CRI utilized 
severaUof t'hese centers as sources of information on individualized 
instruction for this contract, and believes that most of the centers 
already are providing substantial information on 'individualized 
instruction. Tlie final report could be disseminated by such denters 
and serviced without further effort on NIE's part, if it were made * 
available to them, . • - 
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*• The following Exhibit V-1 lists some' of the State Departments 
of Education whicH'are most' active ^in disseminating information on 
educational practices, and Exhibit V-2 lists a selected group of 
information centers serving local, State, and regional/national areas. 
A more, complete and up-to-date list could be obtained from staff of 
NlE*s .Office of Dissemination and ^lesources. 
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Exhibit V-1 



' Selected State Education Age'ncies Involved ig^Dis semination 



Coordinator, Educational 
Programs & Studies In- , 
^ , formation S.ervi[ces 

State Department of Education^ 
Albany, New Ya^c 12224 

Division- of Dissemination** 
Texas Education Agency- 
Austin, Texas 78701 

Office* of. Planning & " 
• dissemination 
South/Carolina State, Office 

Building,. Rm. 1208 
Columbia, South Carolina 29201 

Educational Consultant - 
Division of^t)evelopnnrent 
State Department of Education * 
Raleigh, Nqr,th Carolina 27602 

* » • * 
Kansas^^tate Department. of 
,..^Ed& cation* 
120 Past 10th Streets 
Topeka, Kanaas 66612 

Coordinator, Title III ESEA . 
Sjtate Department of 'Education 
Salt Lake City, Utah 84111 ^ 

Iowa State Department of 

Public Ins traction • 
Grimes Office Building 
^s ^Moines, Jowa 50319 

lixpetipiental & Demonstration 

Centers Program/ 
State DeparttTient of Educatipn 
Lansing, Michigan 48902 * 

Office of Program Development 
State Department of Education 
Trenton, New Jersey 08625 



Bureau of T.echnical Assistance 
Rhode Island Department of 

Education 
25 Hayes Street ^ 
Providence, Rhode Island 02908 ^ 

Arizona Department of Education 
* 1535 West Jefferson , ' 
Phoenix, Arizona 



Educatioh Information Center 
Rhode Is^nd Departmer^t of ' 
Education ^ ' . . 

25 Hayes Street , - 

Providene^, I^hode Island 02908 



Soutti Carolina^State Department i 
of Educaition .* , ? 

Rutledge State Office Blvd. , Rm. 1 
Columbia, South Carolina 29201 - 

4? 

• Director of Di^ssemination 

* State' Department of 

Educatioi). » ' ^ ' 

Boise, Idaho 83706 ' - 

Florida State Depjt. .of Educatibn 
Knott Building" 
Tallahassee, Florida 32304 

- Kansas. State Department of 
Education 
120 East 10th Street ' 
Topeka, Kansas 666l2^ 

Southwestern Education^ 
'Dev*elo^meht Center 'Si * . 
1552 yirest,200 ^orth 
Cedaf' €ity,, Utah 84401 ' \ ' 

pivision.of Development 
iSikie Department of Education 
Public Instruction Department 
^^Ralejgh, North Cardlina 27602 ''^ 
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Exhibit V-1 
(Cont'd) 



Central Utah Educational 

Service Agency 
P. O. Box 607 
Richfield, Uta'h 84701 



Research Coordinating Unit 
State Department of Education 
JefiejT^on City, Missouri .^^65101 
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Exhibit V-2 
, ^^elect.ed Information Centers 



San Mateo County Educational 

Resource Center (SNIERCL 
333 Main Street 

Redwood City, 'California 94063 
Directo-f, 

Instructional Materials Program 
California Polytechnic StVte 

Univ.ersity ^' *• « 

San Lui^s Obispo, California 93401 

E^jRIG Center /or sLience, ' 
Mathematics & Environmental 
Education 

The Ohio State University 

1800 Cannon. Drive * - 

400 Lincoln Tower 

Columbus, Ohio 43210 

Director, Educational Products 

Iriformation Exchange (EPIE) 
463 West Street 
New York, New York 10014 



Executive Director, So^cial Science ^ . 

Education Ctonsortium, tnc. 
855 Broadway 
Boulder, Colorado 80.302 

\ Director, Educational Resource Center 
Area Cooperative Educational Services 
800 Dixwell Avenue 
North Haven>^ Connecticut 065U 

Director, Information S.er.yice> '.\ 
Merritnack Education Center 
101 Mill Road 

Chelmsford, Massachusetts 0J824 

Research and Information Services 
- for Education 
198 Allendale Rpad ^ . 
King of Prussia, Pennsylvania 19406 

Director, Board of^Cooperative 
' Services 
830 South Lincoln 
Longmont, Colorado S0501 
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SCHgOL ATTITUDE SURVEY 
Harold F. Burks, Ph.D. 
FEELINGS I HAVE ABOUT SCHOOL 



My Name 
Grade 



Age 



First 



. Last 



Teacher 



Date 



.ilQ^xQe.lbmgs-ia^ school bother you? Yaur teacher would like to know what they are. Maybe these things can 
be, changed so they do not ups&t-j/Aki^so^much.'Put ap X in the box which best^describes your feelings The X's 
might^be easier to 'SceHf^yquy iT^ a colored pencik ' . . ' 



^^-^.^^.^ vye LEAR^: 



□ 



.:i.th1nlc11im' doing all right: 



Sometimes I worry because I 
^.^pi not doing very well. 



O 



Often I worry because I am not 
I doing very well. 



□ 



i dbn't worry atK>ut grades and Sometimes I worry about grades Often I worVy^about grades and 

niarks. and marks. ^ marks. 



,^3. About Things I Am Supposed To Dp in the Classroom 

□ ' - □ 



□ 



.1 ^usually know what I am 
supposed tQ do. 

4. About Reading 



0 



Sometimes I am not sure what 
am supjbosed to do. 



Often I am not sure what I am 
supposed to do. , * 



□ 




I think I am a good reader. 



Sometimes I worry that I am Often I worry that I am not a 

not a good reader. good reader. 



^. About the Things I Read in School , 



/o 



% □ 



The things I read are interesting. 



6. About Spelling 



The things I ^-ead ^Ve a little bit 
interesting. ^ ? " > 



' Spelling is no problem to me. 

6 ( 

I I 

o 



'7- About Writing^ 



SjometimeS I .worijy about 
spelling, f .; |- • 



" 0 



Writthg is no protrtem to H^e. 

o«fr> 

— " 1 * 



; Sometimes; I worry afc^ut nr^y 
" writing:, * i \ ; 



9^ 

n 



I! i "> 



The tfi i ngs I read are not 
^interesting. 



□ 



Often I worry about spelling. 



□ 



Often I worry about my 
vjfiting. ' t ^ 

r » 



.8. About Arithmetic 

□ 



□ 



□ 



Arithmetic is no problem to ine. 

9. About Playing Ball 

^ □ 



Sometimes I worry about 
arithmetic. 



Often i worry about arithmetic 



Playing ball is no problem to Sometimes I worry about 

" playing ball. 

10, About How I Feel When I Play Gaines ^ 



I enjoy playing games. 



, 11. About Ru!^ for Playing Games 

□ 

I understand the rules for 
playing games. 

12. About phoosing Sides for a Game 
□ 



Often 'I worry about playing 
ball. 



□ 



Sometimes I get nervous playing 
games. 



a 



Often I get nervous playing 
.games. 



□ 



Sometimes I don't understand 
the rules for playing games. 



Often I don!t understand the 
rules for playing garpes. 

□ 



I don't Vt^orry about being chosen 
last. 



Sometimes I worry because 
am not chosen first 



Often I worry because I am 
chosen last. 



13. About the Things We Study at School 
□ 



□ 



I like the things we do at 
school, 

i 

14, About Being In School 

□ 

Most of the time I like being in 
school. 



15. About the Teacher Helping.Me 
□ 



Sometimes^ I ^am. not -^interested 
in the things we dp at school. 



□ 



Often I am not interested in the 
things we do at , school. 



□ 



Sometimes < wish I was out of 
sct;)ool. ^ 

ABOUT THE TEACHER AND ME 



Often I wish ^ I was out of 
school. 



□ 



The teacher hdps me enough. 



□ 



Sometimes I wish .the teacher Often I wish the teacher woufdf 
would help me more. help me more". '. 



16. About the Teacher Calling On Me for Answers 
□ 



□ 



□ 



IPfvifnfhlr?''' °" '-"""'^ • Sonietimes I think the teacher ' Often I think the teacher calls 
as I want her to. calls on me loo much or not on me too much or not enough 

enough:, ■ " 

17. About Things That Bother'Me • 

□ ■ □ 



□ 



' ^ > « u ^ 

I can talk to the teacher as much ^ Sometimes I wish I could talk Often I wish I couldP-'talk to the 

as I want to abodt things that to the teacher about things that teacher about things that bother 

twther me. • bother me. " . , . me. 
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18« About Important Jobs in the Classroom 



.1 have enough important jobs to , Sometimes I wish I had more , Often I wish I had more 
dp4 * / important jobs to dd. . important jobs to do. . 



'19. About Helping Other Children 



a 



The teacher lets me help children Sometimes I wish the teacher . Oftea I wish the teacher would 
as much ds I want to. ^ would let me help children. ' .* .let me help children. 



ABOUT THt OTHER CHILDREN AND ME 



20. About Children in the Classroom Bothering Me 



□ 



The children don't bother me 
much. ' 

21. About Making Friends at School 

□ 



Sometimes the children bother 
me. 



The childhri bother me. a lot 



□ 



I ^|k^how to make friends. Sometimes I wish I knew some 

^ good ways to make friends. 



22. About How the Children Think I Do Things 

□ y I 



□ 



Often I wish i knew some good 
ways to make frfends. ^ 



□ 



The children ^hmk I .do thir\gs Sometimes I think t^e children 

well, .V • . don't think' I do things well. * 



23. About Btirtg a Leader in the Clas^oom 



□ 



Often ) think the children don't 
think \ do things well. 



.1 am often a -leader. 



Sometimes I think I need to be Often I think I need. to be more 
i mcr? of a leader. , of a leader. 



24. About Sharing Things in the Classroom 



□ 



□ 



I share enough with the other Sometimes, I wish I could share 
• children. / more with other children. 



25. About Taikmg with the Other Children 



^tout 
toHalk 



□ 



Often I wish I could share more 
With other children. . 



□ 



I get, to talk enough with Jhe other Sometimes I wish I could talk 
children. more'lwith the other children.; 

26. About My Problems 



Often I wish I could talk more 
witlj the other children. 



: ■- . g ^. • ■ . □. 

Sometirnes I think the .chuklren. . Often I think the children don't . 
don't understand my profilems. ^ understand my problems. 



The children seem, to 
understand my problerps. , 

27. About Saying Wh^t I. think ' 



□ 



1 ran say what I think to other 
children. 
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Sometimes I can't* say what I 
ith'iQkto other children.' # 



Often I can't say what I think 
to other children. 
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ABOUT ME AND MY CLASSROOM % 



28. About How Clos« We Sit together 



□ 



. We sit^'he^' right distajfice from » Sometimes I .think 'we sit too Often I thin1j,^we s\{ too close 

;^^^ach^ther ip: the room. ' ^ , ' " . close or too far apart. "^or too f^ar. apart. 

t 201 About CWr Chaii^.in the Classroom ^ 



Our chairs are easy to sit lA. 

It 

30. About the Noise in the Classroom 



1 



Sometimes I think our chairs Often I think oiir' chairs are 
are hard to sit in. , ' hard to sit in. 



□ 



□ ^ 



The noise does not bother me. 



31t ^65|Jt the Blackboards 



□ 



Sometimes the nbise^^ bothers 
me. 



□ 



Often the noise bothers me. 



□ 



It is easy to see what is onnhis ^ Sometimes it is hard to see . 
blackboards. what is on the blackboard^ 

32. About Where You Can Be Alone in the Classroom 



Often it is hard to see what is 
on the blackboards. 



□ 



' If I want to there is a place to Sometimes I wish there was a Often I v\rish there was a place 
be alone. , > ' place to be alone. < ' to be alone. 



33. About Being Hungry at.School* 



□ 



I usually feel as if I had enough Sometimes I feel.hungryi 

to eat. P . ^ 



34. About the Light in the Classroom^ 



* Often I "feel hungry. 



.□ 



The light in the room does not 
bother me. ^ * 

35. , About Being Tired at School 



Sometimes the light bothers my 
eyes in the room. 



□ 



Often ihe light bothers rtiy eyes 
in the room. 



□ 



I don't seem to get tirftJ at 
sc[iool. 

^6. About Hearing What the Teacher SaVs 



Sometimes I get tired at school. 



□ 



Often t get tired at school. 

4 



□ 



I can hear what the teai:hei; * Sometimes I have |rouble Often I have trouble hearing 
says. * " hearing what , tffe teacher says. what the teacher says. * 



You might like to go backmts^ and circle the numbers of the things |hat bother you the VERY MOST. 

COfYniGHT ©1970 All Rights/Re jLrv«d \ • . 
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LOCUS op: control measure for students 



*^ developed by 

Contemporary Research Incorporated 



INSTRUCTIONS: Each student will have an ansv^er sheet which will 
allow him to mark either "a" or "b" for each item by placing an X it)r 
the appropriate box. Clearly state the number of the item y^ are 
about to. read and then read each item twice. Be sure that the student 
know which chbice^s "a** and which is "b^* pnd that all have mafked 
th^ir responses before going on to the next item. An item may be' 
repeated more than twice if necessary. . • 
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When new school work is easy for yDu to understand, it ye because 

a. you are smart enough to understand it 

b. the teacher is doing a good job of^ explaining it , 

When you do well on a school test, it is because. 

a*. the tes^t is easy . - 
b. you work hard 

If someone thinks you don't do goqd work at'scHool, it is because 

a. you don't do gocyl work ' * , , ' 

b, he doesn't undej-stand what ypu are doi'n^ 

When you get the right answers to math problems, it. is because 

a. you are learning how to do math ' ^ 

. b. the problems are easy ' , , ' ' 

When you have a hard time understanding your scTiool work, it 

is because ^ , 

•* 

a. the le^^son is very difficult • \ / 

b. ' ' *you aren't smart enough ' ■ \ . 

If you don'tjdo well on a school test, it is ^^ecause 

a, you didn't care about the test ' * ' ^ 

b. ' the test didn't make much sense " ' . 

If you do better than usual on your school work,"l?^is because 

% 

a. ' you try harder 

h, the work was ^sier than usual , * 

If^something is easy to learn at^hool, it is because 




attention 



Tfrhirtp- 



b. the teacher gives yrrtr-ie 
Suppose someone thinks you don't do good work at school --^ 

a. you can make jiim change his mdhd if you w^t to ^ 

b. some people will think you don't do.good wo/k no * 
matter what you do - - x/ 
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When you do a f ood jab^pf readiagj. if 4s because* • 

a; ' you ax;e. getting better* ^fc reading • * 
. b/ , the book'was really easy to re^i'.^ ' • ' ' 

If you don't do ^^ery. well on a* scTiopl t^st, it is because y ^ . 

a. » ' /ou aren^t very-smart » • ^ ' - 

b. you we ije 5.ust unlucky ' ^ - 

If someone telL5 'yjou that yoa are dumb, it-is-because 

■' he is mad at* you ^ 

' : ' ~ . - * • ' 'f ' 

b. you did something dumb » , ' 

If you did-worse than .u^ual on something at school, it was because 

a. ' the work is getting *harde"r \ . ^ , ' 

b. you were having a bad day ^ , " ' 

' ^. ■ ^ " ^ 

If a teacher telU you^that you^'did fine work, it j.s^ because \ 

a. teachers usually say that to encourage pupils 

b. * 'you really did do good work * 

When^you do well on a school test, it is because 

a. you really knew the answers , ' " 

b. ' ■ . you were lucky 

If you did v/o^se ^than u^ualy at school, it was because 

• '"ft 
a. , ypu didn't try hard enough i * 

. . , you weren't lucky • > . . ' 

If you-are chosen by^pthef* kids in your class to be on a team . ^ 
of sotoe dort, it'is because 

a. /ou are a good pla^yer ^ - ^ ^ 

b«__ they like you - . ' 

When new school work is very hara to understand, it is because 
a. ^ the tea*cher isn't giVing you enough help 

lp« you don't know enough to understand the new work ^ 
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lACUS OF CONmi^L IN-VFiNTpRY FOR. TEACHERS (READINtS) 



^535^,?f *developt5u by * » 
Contemporary Research IncorpoJrate.d 



INSTRUCTIONS: 



• Teachers explain their students* perfornnance in a varietjc,of ways. 
. The following list contains some factors often mentioned as important 
*i#in determining sttident success or failure ih learning to read. For each 
item Uelow, indicate the extent to wjiich ydu believe each factor is 
related^to student performance. The first list concerns student success^ 
the second list concerns student failure. 



How strongly do you believe ,each of the * 
• factors list^d'below are related to s\icces«8 
in. l earning th read well. ^ 



Scoring * ,7 • ' 

{^) . a. The studdnt works carefully. 

b. .The teach'erds creative. 

c. The student likes the material. 

d. * The teacher likes the' student 



(t) 

<sK 

(ty 

'(s) 



e. The student has, developed good 
' study habits r - ^ 

(s) "'f.; The. student. is alert ^^hen 1 . 
instructions are giveh. 

(t) g. >The teacher is able- to indivi- 
, dualj^ze instruction. 

{s) \ The stucjent Has good academic 
ability. 

(t) i. The te^-cher communicates 'well 
with her students. ' ^ 

'(s) ' 'j. ' The student asks for help when 
he needs it. / 

(t) ' k. ^ The teacher gives a lot of time* 
• *to each student , 

* (S) = Student ' 
'^(T) = Teacher 



Strongly 
Related 


^ j2 


Rarely' 
Related 


Unrelated 




















/ 




- 




) 






















* 









































Scoring: 



(3) 



(2) 



(1) 



(0) 



B-la 



Scoring - ► ^ 

(s) 1. The student is motivated . 
to learn. 

(t) m. Previous teachers prepared 

the student well for his ' 
present classwork. ♦ % 



s) n. The student has a long attention 
span. 



^ (t) o. The teacher is very patient. 

(t> p. The teacher allows the student 
to work at his own pace* 



Scoring: 






How strongly do you believe gach of 
the factors listed berlow are related 
to failure to learn to read well/ 



Scoring 
(s) 



a. The student* s ."lack of 
confidence in himselfi* 



(t) * b. • Lack of teacher time in 
preparing a lesson.. 



(s) 

(3) 
(t) 

(3) 
(3) 

. (t) 

(3) 
(t)' 

(sy 

• (t) 
(t) 
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c. The student doesn't care 
about learning. 



d. 



h. 



The socioeconomic 
background of the student.* 

Teacher's lack of ability to 
communicate with students. 

TMe teacher has a negative 
attitude toward th^ student. 

The student doesn't lis\ten 
well to the teacher^ 

The student is not able to 
keep up with the rest ofUhe 
class. 

i. The teacher doesn't motl',/ 
vation the student to wan\ 
to learn. 

j. The student doesn't Jike t^e 

* teacher. 

k* The teacher doesn't give 

* enough time to each studeitit. 

, r. The student is cal-eless in 
iiis work. 



The teacher does not ^tten i 
' to individual student needs 

n, ' The teacher's instructions 
are inclear^, < 
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Strongly , 
Related 


0 0 ' 


Rarely 
Related \J. 
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Scoring 

. it) p. 



T:h.e student 



The teache 
creative. 



much acad(^ic a-bftitjfv'l 
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XfiLy^ FOR TEAClifeRS (MATH) / 

,^J;/''%y\''^<:'- / ' l*- developed by ..- . ' . ' 

^fi^'^]j0\\^:/^ 1<\'^\^)K^^ Research Incorporated ^ : 



lie* s 'explgiX theilir students* pjerfofmance in a variety of ways. 
.C,^'\t.h^^ fact6r.s often tneptioned as imp^ortant *' 

'/f ' i^la^s^^^ or failure in learning matli, " Fpr each^ . 

,j|'?.ijt<^t5n b^l<iw^.,.iriaidate tfhe.fict^nt to which yoa.believ^^eacli factor ^ 

/ -irelat^gci fo"sl:.udenfc.pe'rf^^^ .The. fir^st. list concerns student success, 

^'.^.Xth^'&Wi^ond tist,cJincerj^^^^ ' ' ' ' ^-^ 



,^.;H$NV3^^tr<y^ belieye/each of the 



; jfa'ctor^' ^sted b^low, a.re ^related to success 



- . Scoring ' 



'{s-Y ' a. . The student works carefully, 
(t)' b. • .The teacher is creative. 



; (S) 



(s) 

(t) 



c. . The student likes the material. 

« 

d. The teachet likes thp student : 

e. T-^he student has developed good 
study habits. , ' ^ ' 

The student is, alert wh^n 
-instructions are given. • 

■ 'r 

g. The teacher is able to indivi- 
dualize instruction. 



(s^^ h. The ^studerit has good acadennic 
- • . al^ility. 

(t) i. The teacher connmunicates well 
•with her students. 

f 

' (s) j. • The student asks for help when 
he needs dt^, • , j 

- (t) k. The, teacher gives a lot of time 
to ea'ch student, 



\^ O 

0^2 - 

■u 


^" 

ft? ' 


■ , 


P 


f 




• 


















— "^r— ^^^^ 








K 










• 








1 0 




t 










< 
» 














t 






t 




1 



Scoring: 



(3) 



(2) 



(1) 



(0) 
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Scoring- * ' ' * 

? • ^ 

(s^) • • The/ student is motivated 
to^Learhi 

(t)^ rru' Previous teachers prepared 
the; s'tuxient well for h^s , 
- : * ' present classwork/ 

is) ni The student has a long attention 
span» ' , - 

(t) * o» The teacher is very patient. 

(t) , p. ' The teachei; allows the student 
to work at his'^own pace. 



i^Scoring: 
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How strongly dd, you believe each o^f 
_ the factors lisj/ed below are re'^lated 
to failure to learn math weii. 



* Scoring • • 

(s) a. The student's lack of 

.-..o... =.lcoQfidgJic^jn_hi.n>self.-.^. 

) b. Lack of teacher time in 



(s) 
(s) 

it 



c. The student..<Loe.sn/t care 
about Fe^rftiAg. ' ^ 

d. ' ¥he*"s6'Cl6econorhic-*: 

background of the stud^ei^t;. 



e» 



communicate.with^studAnts* 



f. The teacher has a negative ^ 
" attitude to^aird the studentC " * 

• T^f '*^'.!€r^\The./i$|:ud.ent dqe^rt!t listen, ; 
*welT to' ttie tea'chei". 



M^V^iffg^ J^T^^ is not ^hX:6^^^^ 

Jkeep 'fi^with the rest ofvtHe 
^ class. 



4 



(t) 

(s) 

(t) 

(s*) 

(t) 

(t) 



1.. 

j- 
k. 

1.. 



The teacher doesn'r mofcd- 
vation the student to want 
to learn. 

The student doesn't like the 
teacher. * 

The tea(?cher doesnU give 
enough time to each student* J 

4 N 

The student careless in . J 
his work. 



m. The teacher does not att„end 
to individual-student needs. 



n. 



The tocher's instructionSj, 
are inclear. 
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Scoring: 



(3) 



(2) r (1) 



17G 



, B-lg 



Scoring 



(s) 

(fc) 



o, . The student doejsn^t have 
much academic ability. 



p* The teacher is not very 
creative. 



Scoring: 
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CLASSROOM OBSERVATION. INSTRUMENT 

,\ Classroom Summary Information 



DIRECTION^ Makt s>jrt that all oi tht idtntifying information has b4tn enttred on tht Claswpom Summary 
iQformatidn form P.^'or to yQur obMrvation of physfcal invironmtnt. Do not makt any st^ay marks outsidt tht 
boxes providid in plaCts mhtrt writttn information is requirtd. Makt sure you coda tht classroom summary 
information form bookJtt rdentific'ation Numbtr in tht j. □. grid of all bcjokltts us«d in th8,ob]trvation. 
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OBSERVER 
NJUMBER 
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©©©© 
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®@®® 
®®®® 
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d).®®© 
@®©© 
©©'®© 
®®®® 
— 



. today;/! date 



mo: day 



®®0® 
©©©© 



2J® 

m 
m 
as 
m 

2 

Dos 



©@|®©|®© 
D® 
5© 

®®|®®1®® 
®®®®®® 
®®l®.®®® 



Dos. 



D© 
Dd 

®@®j®j@@ 
®@®®j@® 
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YR. 



I. D. 
NUMBER 
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^ CLASSROOM SUMMARY rWFORMATION 

Nulnbtr of teachtrs t;hat regufarty work 
' < 1 . in the classroom. t 

. @©©® ® Numbet of aidts that rtgtjlarly work in _ 
; the classroom * i . ' . 

©®©® ® Numbtr of vofunteers/viiitors preient today. 




Classroom Summary Information (Cont.) 
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®fe 
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.A, Numb«i'<ipf ° 
, * i chifdren enrolled 



B.ff^umbtr of childrtn 
present todays , 

. .■' 0 



\ To^al Class Duration 




M 1 1 s 1 1 r . 



0,2yi hours . 
- 0*3 '.hours 
. '03Vi hours 

> * O 4 hours . - * ^ 

04Vi hours ^ ' \ 

. O 5* hours ' ' ' 

O 5Vi hours ^ O . rf 

' ' O 6 * hours ^ ' 

eVi hours ' * ' 

. O ^ 0^ more*,tiours , 

. " NCS Tr^}OQtie^jSai7A'321 * ' 

II 1 1 I II 1 1 1 1 1 ' III i I J II 



Physrcal Environment Informatron 
(Mark all that apply.) 



For' each of the itemj below, mark all 
that apply: 

© Present 
'© Used today 



sSeating Patterns: 
O Movable tables and chairs Jor seating 

purposes. , 
OStationary desks in rows. 
©Assigned seating for at leist part of 

the day. '"^ < 
OChrldren select their own seating 

locations. 

^ ©Teacher assigns chi|(dren to groups. 
©Children select th^lr own work groups. 



QAMES/TOYS, PLAY EQUIPMENT 
©tDsmall toys (trucks, cars, dolls and 
accessories 

©©puzzles, gam^s , 

.©©wheel toys 

©©small play equipment (jumprope$.>alls) , 
©©large play equipment (svyingj, jungle gym) 
©©children's storybooks 
©©animals, other nature objects 
©©sandbox, water table 
©©carpentry materials, large blocks 
©©cooking and sewing supplies 



iNSTRfUcfFONAL MATERIALS 
©©Montessori,' other' educational toys 
©©children's texts, wo/kbooks^ 
G)©niath/science equipmerit, concrete object^ 
©©instructional charts ■ 



AUDIO, VISUAL EQUIPMENT 
©©television 
©®T^cord"br tTpe pilayer / 
©©audio-visual equip/nent 



GENERAL EQUIPMENY, fJlATERI^LS 
©©tf|ildren'$ own products on- display 
©©displays reflecting children's ethnicity 
©©other^displays especially for children 
©(gflmagazines ? ' ' ' , 

©©achievement charts ^ 
©©cfiild-size sink/ ' • 

©©cl?ild-size table and chairs 
©©cbild-siaei shelves • ^ 
©©arts ancf crafts materials , , 
©©blackboard, feltboard 
©©child's'own storage space ' 
©©photographs of the children on display 

OTHER^ ' \ } 
©©please specify m". .'. 




WAKEN'O 



0 ' 




iiiTiiiii 
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I I I I I I I I 



1 1 1 1 1 



STRAY lyiARKS 
IN BLANK AREAS 



t 



mill 



I r 



CLASSROOM CHECK LIST (be $Ure to code EVERYONE m the class) 



1.- Snack, lunch 



2. Group timt ° 



Story 
3. Music 



Dancing 



4. Arti, C#*h» 



'GuMjing Gamts 
5, Tablt Gain«f 
Puzzitt 



/ 



Otv, 

O'Audio-Viiual 

Materiaii 
O Exploratory 

Material! 
O Math and Scitnc* 

Equipmtnt 
OTextj, WorWSookj 
O f\izzlt»,^anie» ~ 



Numbers 

6. Math. 
Arithmetic 



Reading 
7. -Alphabet^ 



ing. Oevelopfntnt 



8. 



Social Studiti 
Geography 



9. 



Science » 
l^afural World 



Sfwmg > 
<;S|okiiS| 
Pounding 
Sawing 



11. 



Blocks 
Trucks ■ 



ONE < 
CHILD 

T CpO® 

A 0©® 
VjO®® 
i/®©® 




©©® ^«J^O©® 
©©© • A©©© 
©©© V©©© 
i ©©©C i ©©© 



TWO , SMALL LARGE 

CHILDREN N GROUPS GROUW " 

-T©©© tO©©© tO© 

A©©© A©©"©© aO© 

V©©© vCD©©© v©-© 

i ©©© i ©©©© i ®© 



t O©©© T 0@ 

A©©©© A O© 

vO©©© .vO© 

i O©©® i O© 



T ©©© T 0®@ T©@®® "T ©0 

A©©© A©©© A©©©© A©© 

V©©© V ©©© V ©©® © V© © 

i ©'©© i ©©© i ©©©© i ©© 



T ©@® T©@@ t0@@© T ©0 

A©©© A©©© A©©©©. A©© 

V©©© V©©© V©©©© v"©© 

I ©©© i ©©© i ©©©© lO©^ 



T©©®. T©®© T 0@®© T ©0 

A©©©; A©©© )A0©©© a©© 

V ©©® V ©0® Jv ©©©© V ©© 

i ©©'© i ©©© ^ i ©©©© i ©© 



T©©© T ©©@ i/T O©®® T O® 
A©©© A©©© /a,0©@© a©© 
V©@©^ V©©© V©©®© V©© 

i ©0© ■ ©©© i ©©©©: ,i ©@^ ■ 



T.O©® T©®® .T©@®©-TT©0 

A©©® A®®®^" AO®®® "^(D®. 

V~®0.® V ® ©©^ ^^©©®© . V ©® 

i ©0© i ©©© i ©©@®' ! ©^ 



T©©© -T©©® -T.©©@© ' T ©0 

A ®®® a'©®®- a O©©'® A ©© 

V©©© V©©© V©0©®._V©0 

i ®©® i ® ®® I © Ig)®® ' LOiH 



T O®® T ©0© T ©@®® T ©0 

A®®® -A©©© A©©©© aO© 

V©©© >tO©© v©@©® jyo© 

■ i ®©© <• ©©© I Q©©© / « Q© 



T 00© 

A O©© 

V ©0© 

I ©©© 



T©©®' T©®®® T 0@ 
a'®®®. A®®®® A©© 



V ©©©^ 
i ©©© 



^2 Dramatic Play 
DretS'Up 



13, Active'Play . 



04. -RELIABILifv.sFlEET 



© 



T ©0® J©©® 

A®®® A©©® 

V®®® Vv'O®® 

i ©©© • i ©^(1> 



V ©©©© 
i ©©©0 



V ©0 

f ©© 



T ©0@® T 0© 

A©©©© A©© 

V ©©©©•- V©© 

i ©@J®® I ©© 



T ©©m-slj©©® T©@@® 'T00 

A©©©© A©© 
V ©^Sp5^^©'© V ©©©®V V ©© 
I ©@© i ©©© » ©©©© I ©© 



"TO®® T ©©@ T©©®® 'TO© 

. A®©^ A©©© A©©©®" A©© 

V-©©® V,©©®*V©©@® V©© 

I©©® i ©©@ i ©©@® I ©@ ' 
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1^5. Practical Skilh Acquisition 



.%6<* Observing 



17.. Social Inttradtion 



Ob 



© 



® 
© 
© 



18. Unoccupitd Child 


tO©® t©©® tO©®® t©© • 

A ©®® A 0©® aO®®® a®® 
V©©© V©©© V©©©© V©© 

i ©©© i ©©©~ i"©1©@® . ©© ' 


19« Disciptint ' 


T©©@ tO©®- T©©@® tQ® 
A®®® A®d)® A®®®® A®® 
v'®®®. 'V®®® V®.®®® V®® 
. ®®® i ®®@ i ®®®® . ®® 


20. Transttiorul Activitits , § 


T©@@ T©@® T.<D©^® , T©© . 
A©©© A©@® A®(0®® .A®© 

v©©© ,v©©© y®®@® 'V®® 

i ©©© i ©©© i ©©©© . ©© 


^ ... © 

21. Classroom Manaoemtnt * ^ 


T©©® tO®@ T©@@© T©© 
A©©© A©©© A©©©© A©© . 
V©©© V©©© V©©©© V©@ 
i ©©© . i ©©© i ©©©<«) i ©© 


22. Out of Room \ X 

/ © 

1 — ■ 1- L-L 


T©©® T©@©- T©©.@® T©© 
A©©© A©©® A®®®©' .A®® 
V=0©© y©©© V©©'©© V©© 
i ©©© i ©®© i ©©©© . ©@ 


NUMBBR OF ADULTS IN CLASSROOM ^ ® ©©®(4)®®'@(a)®® 



ONE 
- CHILD; 

..T ©<D©' 
A'©©.® 
V®,®® 

J©®® 
T©@@* 
A O®® 

vO®® 

i ®®® 



TWO. 
CHttOR&N 
T 0©® 
A ®®® 
V ®®® 
i ®®® 



T©©@ 
A ©©© 
V©©© 



, T©©@ 
A©©© 
V©©© 
i ©©© 



SMALL 

GROUPS 
T ©©©© 

©©©© 
V®©®® 

©©©©-- 



T O©© 
V©©© 



T ©©®®.' 
A ®®®© 
•V ©©©© 
©©©© 



LARGE 
GROUPS 
T ©©■ 

AO© 
V ©© 
i <D® 



i ©©© i ©©© 



T ©©©© 
A ©©©© 
VQ©®® 
i'©©©© 



T Q© 
A ©@ 
V©© 
i ©© 



-T©© 
A ©© 
V ©© 
©© 



' PREAMBLE " 

00 - The original^class teacher ' 
Fojfcus Person Codes: 1 76 - Child codes 

77 - Volunteer ( • 

88;,- Teacher other than designated clas^ teacher 
9d - Aidiuto teacher 



Activ- 
ity 


f 


Yoeui 
Pirton 
Codt 
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FOCUS PERSON 



Q Child 
O Tga cher 



KJ Volunteer 



CONTINUATION 
OF PREVIOUS 

FOCUS ACTIVITY 
©Yes 
© No 



pQcus Person's Name 
•and Number > ' 



9 

(Do not write outside this boxj 



Number of Children Q^©© 
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ADULT 
' • Teacher 
" Aide 
Voluntttr 



Directing 

o 
•o 
.o • 



Participating 

o 

o ■ 
. o 



Observing 

o. 

o 

© 



Not Involved 

' o • 
o 
o 



TIME STARTED 
Hour, , ■ ~ Minut? 
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: Who 
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What 



0iS^©.©©©®® 



How 
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. What 
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Hovir' 
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How 
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How 
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. What . <^How 
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•What 
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How. 
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Who To Whom 
0]©©© ©©© 

©©@© ®r@© 
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What 
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f How 
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•What 
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How 
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School: 



Respondent's Name: 
Length of Interview:^ 



it y /Stat e : 

Interviewer's Name_ 
Date: 
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"IVe nee^ to spena~about"an houFTbgether now to acconiplish two major 
ta^ks. PirsL I need to obtain, from you some descriptive information 
about your fiiassr.oom *and yourself. Second, I heed to give you some 
orientation regarding youi: role as. a .'*participant-obser:ver** in this 
study. ' 0 ^ " , ^ . 

Okay, shall we get started.? . ' ' 



1. 
lA. 



2. 



Would you tell' me how many students are In your class this 



Di)Vo^ work with any students besides those in your regular 
class t . ' * o * 

No 



Yes (How Many 



Do any othef adults sp^d tirtieLin your classroom? 

^No (Skm to tJuestion #3) 

^Yes (A^k Question #2A) 



2A. in •what capacity 



(i. e. , job title), how 6ft 
hQurs>is thi^ (th^se) person(s) in the class^om? 



n, and for ho;0^^many 



Job Title 



Times ^ Average Number of 
Per Week Hours Per ^Time 



Team Teacher 






Re^6urce Teacher 


Subject Matter 
.Specialis± . r 


Paid Aide ^ . * / 


^Volunteer 'Aide 




i , " 


Other, (spej:ify): 




\ * 


Other- (specify): 




J 


188 


•.D-la 





^ . 3.. . Do ^ny students from other classes act as tutors for any students 
your class ? 



_No (Skip to Question H1 ^ * ' 

_Yes^{Asl^ Questions #3A, 3B, 3C, and 3D) v V 



3A. How many of your students receive tutoring Ir-om students from 
other ^p'lasses ? f [ 



y 



3B., How many tutors are ther^-?- , . . ^ 

3C. How often do they work with your students ? - > . 

3D. How much^time on average do they spend working with your 
students 7n a single tutorial session ?_ 

4. Do you have any students in ^our class who do not speak or under - 
• stand enough Standard English to be able to deal adequately with«. 
instruction given in Standarjd„English.?_ _ _ _ 



, X^s, How many (approximately): 



5. Do j^ou know (approximately) h6w m^ny of your students are 

"target" compensatory-education (e. g. , ■ Title I Program) students? ; 

y^s ^how many ? )• ((Zfan-I-have-a list'of their names ? ) 



/ 



■ ' . (Would you find out how many- and which students 

a^^e "fc^rg.§t.';;compensatofy'education student's and* 
report this information to me .before I leavie today?) 

^ (ASK QUESTI ONS #6 AND 7 ONLY AFTER TEACHER HAS .PRO- 

VIDED A LIST OF THE -TARGET" COMPENSATORY EDUCATION 
■ ^ STUDENTS IN THE CLASS. ) 



I'd like to know a little "about the circumstances under which yojur 
students receive their math (reading) instruction. Do ainy of your 
students receive any. of their math,(reading) instruction in some, 
other place besides your classroom? f^-'-- ^ 

Math Reading • . ' 

, No '(Skip to Question #7) 

• l_-Y-es ^Ask Question #6A) , ' 



> . 



ERIC 



' .V D-lb 

f ' ■ mi. 



6A. Would you explain how" this works? Who gives the instruc- 
tion? Which students are involved? (Indicate number of 



compensatory education and non-compelnsatory education 
students involved in each out of class situation for math and. 
reading, ) 



Instructor (Job Title) 



Students Involved 
Comp^Ed, 'Non-Comp, Ed« How , Often 



MATH 



READING 



7. Do any of your students rece^ive math (reading) instruction in your 
classroom? 

Math Reading 

. ^ No (Skip to Question #8) * \ 

[ Yes (Ask Question §7A)' - 



7A. .Would you explain how this works? Who gives ihe instruction? 
Which studentjs are involveii? (Indicate number of compensa- 
to';ry education a^d non-compensatory students who receive . 
math and reading instruction from each instructtDr'. ) 

V ■ > ' ' " r ./ • , 

• ■ \ ' Students" Involved 

'Instructor (Job Title) Comp. Ed. Non-Comp. Ed. How Often 

MATH * " ^ . ■ , \ ; ' 



: ^ 

READING 



'D-ld 

19(1 



o 



8-.. Now, I'd hke to talk to you about your diagnostic activities. For 
how many o/ your sjudents did y.ou do diagnosis oftheir ability - 
interests, needs, e^. , at the beginning of the year? 



(1) None 



(2) Some (Why these stCidents?) 



(3) Most (Why not the other students?) 



(4) All 



9. 



What about at other times during the y6ar, do y6u do diagnosis 
^ of student ability, interests, needs, etc.? 

(1) No * • ; . ■ • , ' 



lOA. 



^ (2) Yes For how many of the students'? 
- How often (on average)? * * 



/ONLY. IF AT LEAST SOME OF THE STUDENTS ARE EVER 
DIAGNOSED, ASK^QUESTIONS lOA, lOB, AND IOC. ) ' 

What kind 6f information are you interested in finding out thro ugh 
your diagnostic activdties? (Check as many of the following as are 
mentaoned by the respondent. PROBE: "Is there any other- kind ^ 
of in%)rmation you obtain through diagnosis?'*) 



^ reaiding ability (general) 
^ reading SjkiUs (sj -. ijfic) 
_math ability (gen'Jral) 



_math skills (specific) 

j>reference ►for physical 
work setting 

_ othfer (specify): 

- — ■ — c ^ 



^othe» (specify): 



^ n^ed for approval/revvard 
interests (likes /dfslikes) 

frustiyation level 

j - ' 

need for peer interaction^ 
need for l^eacher direction 
other (specify);- , 



other (specify): 



ERLC 
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JOsIf (HAND LI3T OF^OSSIBLE RESPONSES T,p RESPONEtENT ) 0£ 
^ ,^u-^the following soarcea or procedures that you USE in diagnosing 

* \><udents, wMiili do you consider the mpst (next most etc. ) impor- 
tant in pro^^ing you with useful ihfdrmation about students?' 

«. (RANK in of der of importance all the following that apply; 
equals the source or procedure the teacher sees as 
providing the most important , information* ) 



previous teach^ers written- 
comttients in student folder 



_ previous grades acTiieved^^_ 
_ s^tandardized test scores 

previous ^teacher s oral ^ 
* standardized sub-t6st scores ^comments from conversa- 
tion 



single-item analyses from 
st^nda^rdized' tesj:s ^ 

Student health records* 

te^clie'T^d'e vised formaly. 
written teats 

teacher devised formdl, ' 



orally administered t^sts 

' c^frnercial progr^iin. 
. written tests or diagnos- 
• tic instruTTjatits ' 

other .(specify^ 




instructional gfoup*level 

. from previous year 

ft ' .* 

:/ informal observation of 

student- in^classroom • 

j informal observatio'if^of 

1 student outside clasVroom 

J ^ info/fmal oxa^l questioning 

\ of student * I 

\ ' conference s" with Istudent* s 



parents 



othe/r (specify):;^ 



IOC, How often do you use the information thatsyo.u.6btain/from^dia*gnos-" 

tic^ activities?.- (READ EACH STATEMENT. , Codes: A =: always, 
V ' tl usually, O = often, S = sometimes, R = rarely, N ='rieVer.) 

(1) to assign students to instructional gfoups? . ' 



(2) to prescribe objectives" and learning activities for the^ 
' entire class ? , ^* 



(3) to provide myself or others with^an explanation of why 
students are perfprming as they do? ' ' - ' 



' D-I'e 



^ (4) to provdde inf6rma±ion»to ofchersr when making i recom- 
• • • , mendaHon concerning the student {e.g. ^ change of cla^s/ i 
*• . ' "'^-repeat gtade, gtc, ) ? . - ' ^ 

. : • ... * . . ^ . , 

_^'(51'tq^prescribe objectives, and lear&ing activifciesrfbr indrvid-- 

ual students? • ^ , * 

(6)» other (sp'ecify): , * • ' - j 



Now Vd like to ask you some qu^iHrlons about you and your educa. 
tional and professional backg^t'ound. 



(Check one): 
"What is^ jif^T age 



male 




/Kich ethnic groap do youCconsidei: yourself a member? 
« 

{1} White (European origin) 

(2) Black 

(3) Mexican American (Chicano). 

(4) Puerto Rican / 

(5) other Spanish origin (specify): 



j_ (6) American Indian (Native American) 

(7) Japanese ^ - . 

(8) Chinese • 

(9) otlifer Asian ;o'rigin (specify): 



JIO) other (specify): 



, 0 
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14»^/ ^ Do you speak any other language besides Standard English? 

• No (Skip to Question #15) >^ ' , * 

; Yes (Ask Question #14A and 14B) - 

; 14A, Which. one{&)? / ' ' - 



15. . riow much formal education did your father(mother) have? 



Father 



Mother 



i4B, Do you use this (any of these) language(s) in your teaching? , 
Yes (Which one{s)?):,^ ' 



(1) some gr,ade school 

c 

(2) finished grade, school , 

(3) some high school . 

(4) finished high s^chool 

(5) some college ' 

(6) finished college » 

(7) attended graduate school or professional 
school after college 

(8) ' don^t know ^ 



16. For how many years have you been teaching? 



17. For how many years have you been teaching third graders? 



18» For how many years have you been employed in this school? 
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19. • "Could you'tell me about the college Segrees and/or credentials that 
you have received? . . ' . 

> ' < . - ^ ■ , ' ' ' 



\ 



20. 









x " - ■ 




] ' 








ft 

• 


Have you acquired any college 
degree or credential? ^ 

No 

Yes (How marly units?): j 


units beyond your highest earned 

I 

/ ' ' ■ - ■ 



21. • ' Ha^ve you,jreceived any special l:rai^ing in the teaching of reading 
or rtiathematics ? ' 

■ /' ■ • ■ 

. ^No, . , ■ * ■ 

. Yes (Could you describe this t jainitig ? How much and of wh^t 

» . ' type of fraini-ng expemenc'e ?,) _ 



THAT COMPLETES THE INTERyiEW^ WE NOW NEED TO-TALK 
ABOUT YOUR ROLE AS A "PARTICIPANT -OSSERVER."-. SHOULD 
WE TAKE A BREAK NOW OR CONTINUE? - 



ERIC 
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OklENTAf ION FOR SETTING UP AND USING THE STUDENT ACTIvflY 
LOG KIT 



As was previpusly explained, you-r participation in this study requires 
that you act as a ^^participant-observer*', by keieging f^ecords of the 
activity of your students with the Student Activity Log. We think that 
you as the classroom teacher are best able to record what your students 
.are doing daring the period of tKis study!. As you know there v/ill be 
additional observation done by pne (or other'outside people), but your 
observations constitute a large and important part of the data collected 
in this study. J ^ 

. Before beginning my explanation of the Student Activity Log Kit here 
(point to materials), I want to stress one important point. Your class- 
room has been selected for inclusion in this study because of the way 
you organize it. We have included in the study^^great variety of ;lif- 

'ferently organized classrqoms. We have not prejudged which type ol\ 
classroom instructional program is most effective, let alone whic^ 
instructional pTOgrams work best for certain feypes'of kids in certrain 
types of schools. The point is that we want, you to record what happens 
in your classroom a^ objectively as possible. There is no nefed/to try 
to fit what happens in your classroom in* some '^deal" model, because 
what actually occurs may be more effective than what some people 
think is ideal. T^us, we want to kno>V what ACTUALLY happen^ in your 
classroom. ' \ / 

(SPREAD OUT THE DIFFERENT MATERIALS IN THE STUDY ACTIVITY 
LOG-KIT) • . • / 

Here are the xfiaterials that'have been de>veloped,to assist you in keeping 
systematic records of your observations of the activity of st^pdents in your 
classroom^ We will go oyer the instructions together, seb!xip the^Student 
Actrivity Log, and.gc|ov^ the prbcedures for using the Log, using 9ome ' 
hypothetical examples. , r , * . 



NOTES TO INTERVIEWER 



Check to see if all materials have been included .in the kit. 
MATERIALS IN KIT: Make sure that first "pressure-sensitive'^ copies 
are properly clipped to Student Activity Logs. Explain to teachex that 
this will allow you to coUecl: copies of the Log when you visit the teicher 
at other times during the year. ' ^ ' ^ ' 

STUDENT NAMES : Explain to teacher t^at the names can be ' 
. listed in any order, t^at seems to make using Ihe Log the easiest. 
Teacher may .want toj)ostpone filling in the name^ .of students 
until after bhe instructions have been completed, so he/she will 
, hav^a better idea of how names can be most conveniently arranged. 

OBJECTIVES ; When assisting teacher in identifying from'l5-20 
instructional objectives for math and^ reading, .explain ETiat objec- 
tives can be chosen from the Sug;gested Lists (see appendices to 
instructionsT, as written or with modifications OR the teacher can 
describe other objectives (BUT th6y should follow the same fotmat 
as those on the Suggested Lists). ^ ' 

INSTRUCTIONAL MATERIALS ; ^xp^^ain to teacher that alf mater^ 
ials used should be listed for math and reading. It may be best ' 
^for teacher to delay listing those materials that may "nofe=be used,, 
. and include them oii the Coding Keys* lists only when jthey have been 
used. ' ' * ' 



(AFTER YOU ANDiTEACHER HAVE GONE OVER THE INSTRUCTION 
SHEET, provide' SOME EXAMPLES TO TEST WHETHER TEACHER 
UNDERSTANDS CODING SYSTEM AND SYMBOLS) 

I 

Do you have any further questions about the use of the Student ' 
Activity Log Kit^ 'Any questions about other aspects of the study? / 
Please feel free to write or call my office if a question arises* Thank 
you again for your time and cooperation. Til see you in about one month, 
at which time we can briefly review how the Log keeping operation is 
going. 



TEACHER INTERVIEW SCHEDULE II 



School: 1^ ^ City:J 



Respondent's Name State:^ 

Interviewer's Name: • • 



Length of Inter v4.ew: , DafeJ 



We'neeci to do two things as part of this fiixal interview of the 3tuHy. 
I'd lilce"tp*as*k soitXe general questions. about your epcperiences in this 
school/ Then, we need to finalize your role as ^'participfint -observer . 

^1^ Firsl^ since ttxis study is concerned primarily with math and 
reading, could you tell^me hq^y many hours per week (approxi- 
mately) do the students in yoUr class spend'on these subje.cts 

• T directly? ' 

a% Math hours m b.- Reading ' hours 

= - • . : \ } 

2. Are there subjects which. you consider to be related to reading* 
on \yh'ich your students receive instruction?, 

\l) No . * ' ■ . ' ' 



_^ (2) Yes. ^ How many hours per weelj: (approximately) 
'do.you students spend on these sub j-e^cts ? 



0 , 
3^ • Are, thei^e subjects which you consider to be related to math? 

■ • (1) No , 



t • . ^ 

(2S) Yes. How many hours per week (approxirnately) 
; do you students spend on these subjects? 



Moving on to another topic,, is there any time during the scjiool 
day that is specifically set aside for you to do instructional plan- 
ning^-..;That is, is there any time during which you are released 
! from the responsibility of supervising students to do you]^ instruc- 
^ tional planning? 

^ iMo (Skip to Question #5) 

^ Yes (Ask Questions #4A and 4B) '] 



D-2a 

198 



4A. How often is such time provided? 
daily 

a few times a week ^ 



once* a week 



less often (specify): 



»4B, How much time is usually provided for each planning period? 
^ ' ' __'hours i:' ' 

5. . Quring the last twp years have there been any '.ilnser vices organ- 
^ * izjsd.by thi-^. sch6ol or school district? "{v: 

• No (S'kip to Question #6) 

' y. Yes ,(Ask Question #5A) 



5A. Have ai^y.of feh^eae insei^vices focused TOi-tire i&sue of individualiza 
* - • tiop' of 'instrucrtion?: ' . ri< 



No • (?kijHt©-Quis_tiDn- #6 ) 
Yes (Continue with Questions>#5B and 5C) 



\5B. How many such sessions have been offered!? 
' How many of these have you attended? 



li\ thinking about the way you've organized.your class for 
-instructional purposes this year, is it fai;E:%:| knilar to the 
way you did it last year,, or have you instituted major changes? 

^ame'as last y^ar, (for hdw mafty years have you 

been organizing your class ;4n this way?): 
. / . . . y ears 

(2)' somewhat differ ent^^tlTen ia^t year (could you tell 
me how it is different^?-)!" 
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(3) very different from last yeaV (would^ you tell me 
how it is different?)-: , ' * 



7. Have any of the parents of students in your, class rfeajcted 

POSITIVELY or NEGATIVELY in'the way you havfe organized 
your class for instructional purposes, this year? 

No (Skip to Question 

Yes (Ask Questions §7A and 7B) 



7A. How many reacted negatively? 
7Bi. How many reacted positively 



8, Moving on to another issue, how often do you^communicate to 
parents in writing about the progress of their children ? 



(IF TEACHE^l EVER COMMUNICATES TO PARENT'S IN WRITING 
ASK) Can I have a copy of the form (s) you use for this purpose? 

(1) Yes (obtain a copy) 
' (2) No (Why not?): [ ^ , 



9. HoNv often do you meet with parents to discuss the progress , of thei 
children? 



9A. (IF TEACHER EVER M^ETS WlTH PAPfENTS, ASK) What kinds 
of things are generally .discussed ? 



Now I would like to. ask you a few questions about how decisions about 
curricular matters are made in this schools? 
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10. 



Do any parents or other community people participate in this 
decision making process? (If Yes) How many (approximately)? 

k \__ none (Skip_ to Question #11) 

•'' (2) just a few' . . 

. (3) many of them 



(4) almost all of them-. 



ASK 
QUESTION 
. # 1.0A 



lOA. 



• • i 'V • .. , 

^hat is theij: role? j \- > . 
(1) able to make final de<j:isions 

(2)' share authprity for^final decision making with 

administratdrs, teachWs, etc. 

1 (3) Serve in an advi's^ory capacity to administrators, 

teachers,, etc/ v> ' ''V 

(4) participate, but only in| an observer role 



11. 



What about teachers in this school and How many of them partici- 
pate in making decisions about curricuTar matters ? 

/(I) none (Go to *'Debriefing| Session) 

/ I 

(2) just a few 

/ ^ y 

. (3) many of them 

(4) almost all of them - 



. L, — 



ASK 
QUESTION 
^ llA 



11 A. 



What is their role? ' 

(1) able^to make final decisions 



(2) sjia^^ authority for final decision making with 
other groups 



J (3) serve in an advis ory^ capacity to other groups 



(4) participate, but only in an observer role 



J' 
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. STUDENT ACTIVITY LOG t)EBRIEFING SESSION 

Now I'd like to talk with you abput the Student Activity Log that you have 
been using to record your ''observations " of your classroom. You might 
think of this as a '^debriefing"" session. 

First, let me thank you again for your help in providing this information. 
As I mentioned before, this part of the data collection process is 
extrefnely important to the -entire study. Therefore, we want to make 
sure that the information provided is complete as possible. 



INTERVIEWER; Briefly look over the Student Activity Logs, 
checking to see that: 

1) all cells in the Log have some marking on them, 
either dates and codes, or the words, "after, " 
"before, " or "not relevant; " ^ 

2) a beginning and ending date have been entered for all 
relevant cells on the Logs; 

3) the number of hours on task have been entelred for 
each relevant cell; 

4) at least one code for Materials, Physical Setting, 
Social Setting, Teacher Behavior, and Student 
Behavior, .have been entered in each relevant cell, 
(Remember there is* a specific code to indicate if; 
no teacher«was present, pior peers were present, 

no teacher behavior was involved, or no materials -* . 
* were used); 

5) all codes entered on the l^ogs have a referent on the 
Coding Keys. (In the case of Physical Setting, 
Social Setting, Teacher Behavioy,* and Student 
Behavior-^ there is a given fixed number of codes, 

while in the c^se of Materials there can be a. \ 
variable humber, however des ctiptions for^each 
code should be entered on the Coding Key); 

6) the nrimber of objectives on the Logs matches the 
number of descriptions of objectives liated on th^ 
Coding Keys-; and, c ^ 

7) all codes and descriptions arelegible. 

Any problems or discrepancies should be discussed. 
' with the teacher and rectified. r ^ 

Okay, now I*d like to ask you a fe.w questions concerning the activity 
that you/ have obs erved and coded on the Student Activity Logs. 
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12. Can you tell me how the math (reading.) objectives for each-^student 
are determined?- (IF* THERE^ARE ANY CELLS THAT ARE 
. . MARKED ^'NOT RELEVANT, " ASK/ How do you determine that 
some objectives are "not relevant" for certain students? (Check 
one for both math Vnd reading. ) A 

7 

Math Reading ^ ' 



(1) .iPrior to start of year, administrators 
'^or teachers prescribe the set of objec- 
, tives that the class (grade level) will 
;work on. * 

Instructional materials or commercial * 
programs provide a set of objectives 
that are applied to students using them. 



(3). Students decide (via a vote, etc. ) the ; 
Set of objectives to be work^ pn ,by / 
the class , ^ ^ 



(4). Teacher diagnoses -students and pre- 
scribe^ the set of objectives that'the 
class will work on. 



(5) Teacher diagnose^^'^studenfcs and assighs 
, thern to instructional group for which • 
^ a set of objectives^is prescribed, 
(group. sizes ): 



(6) Individxaal students^choose the objeC' 
tives that they will work on. - 



(7) Teacher'and student ne'gotiate a !' 

"contract, " specifying the set of objec- 
tives to be worked on. 



(8) Teacher diagnoseM students and pre- 
scribes which objectives they should 
work on as individuals* 



(9) Other (specify): 



ERIC 
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How is the sequence of w^irking on math (reading) objectives 
determined? '(IF IT APPEARS THAT AT LEAST SOME STUDENTS 
WORK Or^ OBJECTIVES IN DIFFERENJ SEQUENC-ES, ASK, Why 
do some students work on .math (reading) objectives in a different 
o^rder^? (Check one for both m'^.th and readings ) 



Math 



Reading 



< 



(1) 



(2) 
(3) 

(5) 

(6) 
t: 

(7) 



Sequehc^ is determined by subject matter,, 
.instructional material^ or teachers' and 
adcninistcators ' decisions prior to the be- 
ginning of the year. 

Students decide (via a vote; etc. ) the se- 
quence on which the objectives. will be 
worked by the class as a whole* 

Teacher diagnoses students and prescribes 
the sequence on which obj^ectiVes will be 
worked for the entire class. 

Teacher diagnoses students and assigns 
thpm to an instructional^ group for which 
the sequence of objectives is determined 
(group sixes): . 

Individual students chojDse-the sequence on , 
which they will work.oA objectives. 

Teacher and student negotiate ''contract" 
• specifying* the sequencejfor working on 
objectives. 

T.eacher diagnoses^studerits and prescribes 
the sequence-.on which objectives will , be 
forked on. 



(8) :Other'(sp«^ify): 



?04 ' 
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What determines the amount of time tliat students spend working- 
on particular math (reading objectives ? (LOOK DOWN SEVERAL 
OF THE COLUN/iNS OF THE LOGS-.IF THE NUMBER'OF HOURS 
THAT STUJDENTS ST^END Olvf GIVEN OBJECTIVES VARIES, ASK, 
Why do some students spend more or less time working on some 
math (reading) objectives? (Check one fox both math. and reading.) 



Math Reading 




(1) Time allotted is determined by instructional 
materials, and /or teacher /administrator 
decision prior to beginning of the school 
year, » 

(2) Student decide (via a vote, etc. ) the amount 
of ti'me that the class will spend' in working 
on particular objectives, 

(3) * Teacher diagnoses students and prescrib,es 
how much time the class will spend working 
on, particular obj active s"i 

teacher dic^gnoses students, etc. and 
.assigns' them to an instructional group 
which tlie length of .time spent in working 
'on given objectives is determined* 

(§) Individual students work on particular ob- 
jectives until they have completed them. 

(6) Teacher diagnoses students and allots time 
for working on particular objectives accord- 

* ingly. 

(7) pth^r Cspe.cify): - ' ' 



. < 
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How are instructional materials selected for students whd are 
working on particular nnath (reading) objectives? (LOOK-^OQWN 
COLUMNS OF LOGS- -IF THE. MATERIA^LS USED BY STUDENTS 
SEEM TO VARY, ASK, Why^do students use different materials 
when working on particula^r math (reading) objectives? /Che<:k 
one for both math and reading. ) 



Math Reading 



(1) Materials determined by teacher'and/or 
"administrator decision prior to beginning 
of school year. 



• (2) Students dec3,de (via a. vote, etc. ) which 
materials will be us^d when working on 
particular objectives. . * ' 

(3) Teacher diagnoses students and selects 
the matTerials to be used commonly by ^ 
the entire class. 

(4) Teacher diagnoses students and assigns 
them td instructional groups for which 
instructional materials ar'e selected. 

(•5)" Individual students choose Ihe materials 'r^ 
' ^ they will use when working on particular ■ 
objectives. 

(6) Teacher and student negotiate '^contract" . 
specifying the materials to be used when ' 
working given ob;f^ctives. 

(7) Teacher diagnoses students and prescribes 
for individuals which materials will be 
used accordingly. 

(8) Other^pecify): , 
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Thinking about the teacher beliavior categories that you, have used 
for coding the logs, how do you determine which type of teacher 
behavior to use when dealing with students working on particular 
math (reading) objectives? (LI)6K DOWN COLUMNS'OE*" LOGS- - 
IF THE TEACHER BBHAVIORS SEEM TO VARY,, ASK, Why do 
some students receive' different kinds of teacher beha vior when 
they are working on particular math (reading) objectives? (Check 
one for both math and readings) 

Math ^ Reading 

- (l)v Teacher has developed with experience 

\the best things to do with all students 
who are working o^ particular objectives. 

(2) Students decide (via a vote, etc.) what 

kinds 'of things the ty&acher should do in 
working with the enfll^re class. 

- (3) Teacher diagnoses students and decides 

what would be the best things to do when 
working with the entire class. 

(4)' Teacher diagnoses students and assigns 

them to instructional groups for which 
• the things that the teacheVdoes in working 
with students is determined. 

• ^ 

^ (5) Individual students determine (by asking) 

what the teacher does in working with 
them. 

. (6) Teacher and student negotiate "contract^' 

' ^ specifying the things that the teacher . 

should do in wdrking with the student on 

particular objectives. 

1* (7) Tea.cher diagnoses students*and determines 

the b^jsfc things to do \yith each student who 
^^^^-J' " is working on particular^objectives. 

(8) Other (specify): 
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Thinking now about the physical setting categories that you use4 
for coding the logs, how is the physical sertting deter nained for 
students working on particular naath (readuig) objectives? (LOOK 
DO.WN COLUMNS OF LOGS-.IF STUDENTS APPEAR TO WORK 
IN DIFFERENT SETTINGS FOR GIVEN OBJECTIVES, ASK, Why 
do Sonne students work in different physical settings while pro-^ 
ceeding through .partictilar math (reading) objectives? (Check one 
for both math and reading. ) 



Math 



Reading 



(I) Limited facilities, school regulations, 
or subject-matter determine where 
students"work. 



(2) 



(3) 



(4) 



Students decide (via a vote, etc. ) wherte 
the entire cl^ss or group will work on » 
particular objectives. 



de- 

will work 



Teacher diagnoses students 
termi,nes where the enti 
on particular objectives 



Teacher jdicLgnoses students and(^sslgns 
th^em to an instructional group for which 
the setting is determined. v 




(5) Individual students choose where they 
will work on paijticular objectives. 

(6) Teacher and student negotiate "contract" • 
sp'e.cifying where particular objectives , 
will be worked on. ^ 

(7) Teaciifer diagnoses students and prescribes 
^ for individuals where they will work on 

partifcul%;r objectives. * 

« (8) Other (specify): ' / 
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Thinki ng now 3.boiit the pupil behavior categc^ries jrou used for ♦ 
coding the logs, hovg^ de you determine, who W.orks together (both 
students and instructors ) while^ proceeding tht'ough particular 
math (reading) objectives? (LOOK DOWN cdiLUMNS OF LOGS-- 
IF DIFFERENT STUDENTS APPEAR TO WORK IN DIFFERENT 
SOCIAL SETTING WHILE PROCEEDING THROUGH^GIVEN 
OBJECTIVES, ASK , Why does the social setting vary for students 
working on particular math (reading) objectives!? 



Math 



Reading 



(1) All students who are working on a given 
objective work together. 

(2) ^bility groupings deterrrline th« other 
students with whom a sLujdent works on 
particular objectives. 



(3) 



(41 



(5) 




Ability grbupings determine the other 
students with whom most ^students work 
on particular objectives; some students 
work together because they like each 
other or because teacher think$ they 
^ work well together. 

All students -choose who theV-^Will Work 
. with ©n particular obje.ctives. 

Teacher diagnoses students an^ decides 
on the 'basis of something 6ther| than 
ability who is grouped togetherito work 
.on particular objectives. 

Other (specify): 
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Now, thinking about the pupiTbe^^c^ <:ategories used fcj'r coding 
the logs, how do you determine wj(atf Hi*nd' of things stufients do 
when working on particular nnath 'H[re.a:ding) objectives^ ^LOOK 
DOWN COLUMNS OF LOGS--IF STIjb^;NTS APPEAR TO HAVE 
DIFFERENT PUPIL BEHAVIORS ASSOCIATED WITH GIVEN 
OBJECTIVES, ASK, Why do some students do different things 
in working on p^articularlhath (reading) objectives? 



Math Reading 



(1) Activity determinejd by rr^ate rials or 
teacher and/or administrator- decision 
prior to start 'of year. 

(2) Students decide (via a vote, etc*.) what 
activities the class will do when, working " 
on given objectives, 

(3) Teacher diagnoses students and prescribes 
the activities that the entire class will 
engage in'together. 

(4) Teacher diagnoses students and assigns 
them to an instructional group for wfiich 
the type of activity to be done while ' 
workii^g on given objectives is prescribed. 

v^-(5) Individual *studehts choose the type of' • 
.\,activity .to be^done in working ofi given 
objectives, ' ^ 

(6) - Tea^^r aftd s'tudent negotiate ^'contract" 
* specifying the type of activity to be done 
in working on particular "objectives. 

ifl) Teacher diagnoses students and prescribes 
for individuals the type of activity to be 
dorife in working on particular.^bjectives, 

(8) Other (specify): 
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I woul^ like to ask ypu a few questions nrow abou^ your reactions to the 
Student Activity Log. 

20» Would you say that having to keep the Ic/g helped you, hampered 
you, or had no effect on .your teaching ?j 

^ 7 

(1) helped me i 

' f 

(2) hampered nie 

1 \. 



(3) had no effect ^i^. 



20A. \^hy do you say this? 



21 
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Do you think other teaiihers might p 
logs for their classro&ms? 



(1) 
(2) 
(3) 
(4) 
(5) 



rofit from keeping similar 



YES, a l|t^ 

YES, sor^ewhat ' ^ ^ y" 
Perhaps/jmot necessarily, or it depends 
NO, not rieally 
NO, defitfitely not 



Finally, for each name listed on the Student Activity Log for Math 
would you please indicate the number of 1) total number of days 
absent and 2) the number of days of excused absences for each 
student for the cuTrentlschoor year. Write these two numbers,^ 
separated by a slash mkrk (i. f; , total number of days absi^nt/ ' 
number of days of excufeed absences), below each student^s name 
on the Student Activity Log for Math. 
^ . ' .Ip 

That is the end of the final intei^yiew. 



ON BEHALF OF MYSELF ANDjTHE ENTlRlE RESEARCH TEAM, T 
WOU^.LlkE TO EXPRESS A SINCERE THANK YOU F9R ALL YOUR 
TIME AND EFFORT. You really .have made this study possible and have 
render'^d an invaluable service* p(^you have any final questions or 
comments ? Thank you again for J^pur cqopef atidn in this important study. 
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PRINCIPAL QUESTIONNAIRE 



School Na^c: 

School Address: 
School Phone: { 



Date: 
City: 



State: 



Zip 



L 
2. 
3. 
4. 



How long have you been principal of this school*S^_ 
What is your school enroUmenb? 



What is the district enrollment {K-12)? 



What is the total cost of your instructional program (excluding 
transportation and food services)? 



Please indicate in the chart below, the amount of compensatory 
education fuxids-that your school receives through various federal 
and state programs. 



Funding Source 



Amount in 
Dollars 



Please indicate in the following chart, the total number of ^ach 
category of personnel (including yourself) at your school. 



6A. 



ntic 



4>iease indicate how many in each category receive 
e or all of their salary from and compcnaaycpry cdu- 
ion funds. 



V 
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Category 



Total 



Number receiving at least 
part of their salary from-" 



Administration 




• 


T eacher 






Aide 






Specialist ^ 






Counseling and 
Guidance Personnel 


t 





Support Staff ' i • 


t 




Other (Specify); 







In different schools various criteria are used for assigning students 
to specific classes. What is the most important criterion that is 
used for assigning 'students to classes in your school? (Circle the. 
appropriate number* ) . * • 

1. age of student ^ 

2. achievement level of student 

3. • personality characteristics of teacher and students 

4. random assignment 

5. other (please specify): 



J 



Is your school currently involved in a court-ordered racial inter- 
gration program? (Circle the appropriate nunjber* ) 

1. No (please skip to question #9) 
Z. Yes (please answer question #8A) 

8A, Is this a current, source of conflict* in the community ? 
-'(Circle the appropriate nuix^ber. ) 

/ I. No 

, ' -J 

t 
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Please rank the following groups of people in terms of their level 
of pjar^ticipation in making final decisions about curricular matters 
for your school. (1 ^ highest rank) 

« 

1. school boaid members 



j_^2. school 'district administrators ' » ^ 



3/ you as principal (and your assistant principal (s)) 



4. teachers 

5. parents and other community members 



'6. other (please specify): 



How many parents or other community people participate in this 
decision making process? (If Yes) How many (approximately)? 

_^ (1) none (Please skip to Question #11) 

(2) just a few-- 



(3) many of them 

"(4) almost ^11 of them- 



PLEASE 
ANSWER 
QUi:STION 
#10A 



lOA. What is their role? ' , ' 

l^^'^) ^^^^ to make final decisions 

(2) share authority for final decision 
^i, making "with administrators, teachcrj^ 

V . • ^rp^ etc. 

(3) serve in an advisory capacity to admini 

strators, teachers, etc. 

«. 

(4) participate > but only in an observer 

role. 



E.4 

216 



u. 



12. 



What about t^eachers in this school a^d how many of them participate 
m making decisions about curricular tnatters? 

(I) none (Go to,^estion #1.2) 

. (2) just a few 



J3) many of them 

J4) almost all of them 



PLEASE 
ANSWEP 
QUESTION 



llA. What is their role'^ ' ' 

(I) able to make final decisions 

^(2) share authority for final decision making with 

other g roups 

(3) serve in an advisory capacity to other groups 

(4)^ participate; but only in an observer role 



In gene«r^i, how supportive of,your school are most of the parents 
in this 6orfimunity? (Circle the appr.opriate number. ) 

1. extremely * 

2. moderately 

3. slightly 

.4. not at4ll ^ ' ' . . 



Thank you very much for your time and cooperation. 
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APPENDIX F. STUDENT ACTIVITY LOG 
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A. INSTRUCTIONS FOR USING THE STUDENT ACTIVITY <.O0 KIT 



IVitroduction ' ' . , " ^ . ' 

* ♦The Student Activity Log Kit has been devised to assist you in 
performing your role as participant-observer in this study. After 

familiarizing yourself with the materials In'the kit and setting Up the 
Student Activity Log, you should find it relati^vely ea^y to systematic- 
ally record the instructional acfivilfie&^*n which your students engage, * 

llvlaterials Included in the Kit • 

I ■ C » * ' t 

In addition to- the Instructions for Using ttie Student, Activity Log 
<it, there are fodr kinds of mat6riajs in this kit: 1) Student Activity 
Log--Math, 2) Student Activity Log--Reading, 3) Coding Key for Student 



Activity Log--Math, 4) Coding Kjey for Student Activity Log- -Reading, • 
|5) 'Suggested Objectives for Math^^ and ,6) Suggested Qbjectives for Rjeading 

Students* Names = . ' . ^ 



The name of every student i^n youi* class should be entered along , 

the left side of the Student Activity Log--Mat:h^rid similarly*, /along^ 

the left ^side of the Studen^ ^Activity Log- -Reading, In listing the^-naryes 

several strategies can be followed. For example, if stud^nf^ tendjfo 

be grouped for instruction in the subject the fiames c'an be entered i 

reflecting these groupings (alphabetized within groups)*. Otherwise, , 

' . ' ' ' * :' ' ^, • * • 

students' names can be listed in alphabetical order / or]^in the"* way th^fl 

! ' * ' ' \ ' ' . 

you find them easiest \to re^i^rence. The names of rtevf students sljould 
,be listed when they enter the class (with the date entered) given in 
j^parentheses. The names. of students who permanently leave your class 
should be "crossed-out". 
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Instructional Objectives--Math - ' , " ' 

Osing the Ceding Key for the Student Activitv%og--Math, you 
should tist between 15 and 20 instruction^-^ objectives that will prob- 
ably be worked on by one or more of ypur' students during the first 
semester of this school year. A suggestive' list of instructional 'object- 
ives for math is provided ip.tK« next section. If you find any of these* 
objectives to be relevant to your class, 'then^they can be listed on the 
coding key. If the suggestive list does fittt provide the nece;psary 15- 
20 instructional objectives, then you can generate your own'. The ones 
you generate slfould follow the same pattern as those on the suggested 
list. That is, the objective's should pertain to behavior- -what a student 
wil]rdo--atKi tffie objectives should deal with instruction that might 
normally take between 1 and 2 weeks to complete. (The field staff mem 
ber can give you a more detailed explanation and^assist you in describ- 
ing objectives in this fashion: There are obviously other ways to des- 
cribe objectives, however to provide* some degree of uniformity in the 
study, all teachers are being asked to describe THEIR objectives in 
thi^ manner). v ' 

Descriptors for Instructional Objectives-^Math 

For each instructional obje^ctive listed on the Coding Key for the 
Student Activity Log (see instriictj^?t5% afbpv^e) a one or tv/o word ^es- 



j »^ ■ criptor should be created and Written n6xt to the description of the 

^ instructional objective on the Coding Shee't For the Student Activity Log. 

ALSO, tl^ese descriptors shpuld be entered across the top of the Stud- 
ent Activity Log (one descriptor per colujmn) iiTthe same order as they 
appear on the Coding Key. 

Instructional Objectives- -Reading. 

T • The same pro'c.edure should be followed in generating 15-20 ob- 

jectives for reading as was followed for the math objectives. A list 
of ;3uggestive instructional objectives is provided (in the next section) 
and the field staff member. will assist yoli. The objectives for reading 
I should be listed on the Coding Key for the Student Activity Log--Reading, 

•' . : F.3 ... 



Dascriptors for Instructional Objectives-^Readihg 

As in the ca^e of math objectives," one or two word descriptors 
^ u. — __^jhould be created for each reading objectives. These descriptors 
should be entered next to each objective description on the Coding 
Key for the Student Activity Log--Reading, as well as being entered 
across the top of the Student Activity Log-"-Readin| (one" descriptor 

per column) in the same order as they appear on the Coding Key. . 

, •>■ 

r 

^ Instruc tional Materials- - Math 

The names of specific instructional materials for math (e.g. , 
textbooks, workbooks, mimeographed work sheets, manipulatives , 
etc. ) should be listed on the Coding Key fo^f'^the Student Activity Log-- 
Math, Additions to this list should be made kt any time during the 
study when new materials are acquired. This list of materials will 
be used on the Student Activity Log- -Math to code what materials stud- 
ents use when working pn given objectives. Notice that the' '*M'40^"* code 
has been designated to signify that no ins^tructional materials were ^ised. 

Instructional Materials--Reading » ^^^^-'^ - 

Similarly, the names of specific instructional materials for read- 
ing (readers, free-reading books; workbooks, audio-visual equipment, 
etc. ) should be listed on the Coding Key for Student 'Activity Log--R,ead- 
ing. ^Additions to this list should be made a't any time during |:he study 

when new materials afe acquired. This list of materials will be used 

^ J • • ■ . , * . 
to code on the Student Activity Log--Re^ding wjiat material^ students 

, o 

use when working on given 9bjectives. Notice that the "M40'* code has 
been designated to signify that no instructional materials were used, 

THE FOLLOWING INSTRUCTIONS APPLY TO BOTH MATH . 

AND READING STUDENT ACTIVITY LOGS, 
«• » • 

Using £he Student Activity Log - 

, . .. Severat'kinds of information are recorded on the student activity 
log: 1) beginning date, 2) ending date^ 3) number of hours on task, 
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and codes for 4) materials , 5) physical settin'g, 6) social setting, 
7) teacher behavior', and. pupil behavior. ' / 

Beginning Date ^ ^ ' 

Whenever ond or more students in your class starts work on.an 
, instructional objective, the beginning date (e^. g. , "10/5" for October 
5th) should be entered in the upp^r left hand corner of the appropriate 
cell(s^ on the Student Activity Log for Math or Reading. 

Ending Date ' 

Whenever one or more students in your class stops working- on 
an instructio'nal objective (either as a result of completing the object- 
ive or because he cannot ar will^not be completed for an indefinite 
period, the ending date\(e??g., lO/^-O^'Tor October 2t)th) should be 
entered in the upper middle section of the appropriate cell(s') on the 
Student Activity Log for Math or -Reading. \ 

9 

Number of Hours on Task 

Whenever one or moVe students stops working on an'^ objective; 
the approximate number of hours that th^ student(s) has (have) spent 
Workington the objective should be entered in the upper right hand cor 
ner of the appropriate cell(s) on the Student Activity Log for Math or 
Reading. IT IS A GOOD IDEA TO USE ''HASH MARKS*' (i, e. , // ) 
to indicate the number of hours worked on the particular objective by 
giv^ri students EVERY DAY. (It is important to make an accurate 
e^stimate of the number of hours that students actually are engaged on 
a specific ol?j'ective, because beginning and ending dates do not really' 
indicate how much time students spend working on instructional object 
ives. " . 

Code for Materials ♦ ' ' ' ♦ i 

For each student working ou an instructional objective, the letter 
number code for any materials that students use should be entered in, - 
the appropriate cell on the Student Activity Log for Math or Reading. * 
This may involve entering one or more codes, depending on the numbe 

f'.5 
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ot different materials that are used. EACH LETTER - NUMBER COD^ 
SHOULD BE CIRCLED, to ensure that they can be distinguished. 

Code*'f(j^hysical Setting . ^ . - ... 

For each student working on an instructional objective the letter- 
number code associated with a'rly physical setting in which the student 
works should be entered in tHe appropriate'cell of the' Student Activity 
Log for MATH or READING, This may involve entering several codes 
in one cell,. Allowable codes and descriptions of the physical setting 
associated with each code are' listed in the Coding Keys. EACH LET- ^ 
TER-NUMBER CODE ENTERED ON THE LOGS SHOULD BE ENCIR- 
CLED, to ensure that they cap be easily distinguished. 

Code for Social Setting 

For each student working on an instructional objective the letter- 
number code associated with any social setting in which the student 

> 

works (i«e, , with whom the student(s) work) should be entered in the* 
appropriate cell(s) of the Student Activity Log for^MATH or READING, 
• This may involve entering several codes in bne cell. Allowable codes 
. and descriptions of special settings associated with each code are list- 
ed in the Coding Keys. EACH LETTER-NUMBER CODE entered on ^"^'-^ 

the Logs SHOULD BE ENCIflCLED, to ensure that they can be easily 

fa 

distinguished. 

Code for Teacher Behavior 

For each^student working on an instructional objective the letter- 

, ft 

number code associated with any teacher behavior that is involved in 
the student instruction should be entered in the appropriate cell(s) of 
the Student Activity Log for MATH^or RtAtflNG. This may involve 
entering several codes in one cell. Allowable codes and descriptions 
of teacher behavior associated with each code are listed in tfee Coding 
'^Keys. *£A<:H LETTER-NUMBER^ CODE entered on the Logs SHOULD 
BE ENCIRCLEI?, to ensure that they can be easily distinguished. 
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Code for Pupil Behavioj 

, For each student working on an instructional objective the lettir. 
number code associated with any behavior t^afe. the student engages in 
while working on the objective should be entered in the appropriate / 
cell(s) of the Student Activity Logs for or READING. This rhay 

involve entering several codes in one celL ^All-o.wable codes and des- 
criptions, of pupil behavior associated with each code are listed in /the 
Coding Keys. EACH LETTER-NUMBER CODE entered ori th^ lo/s ' 
SHOULD BE ENQIRCLED, to ensure that they can be easily distin-, 
guished. 

Weekly Reports to the Data Collection Field Supervisor^ " 

Every Friday a copy of the ^Student Activity Log--Math and a copy 
of the Student Activity Log--Reading should be mailed to the /Data Col- 
lection Field Supervisor u'sing the postage paid, previously addressed 
envelopes-. A new copy form should be attaciied behind the Student 
Activity Logs for both Math arid Readwig to allow copies to /be made 'of 
the following weeks activities. (Shfcmldydu have any questions' or com." 
ments for the Data Collection Field Supervisor,, they shoiild be enclosed 
on a separate peice of paper in the same envelope. The /Data Collection 
Field Supervisor will contact you as soon as possible toirespond to your 
questions or, coqnnients). If you happen to forget to ma/l the copy forms 
on Friday, please do so as soon as possible thereafter/ If the Data ' 
Collection Field Supervisor has not received a weeks iopy form before 
Tuesday of the following week, y.ou will be contacted by phone so that 
the copy can be obtained for the research project. 



Completing the Log at the End of the Stbdy 



At the completion of the study," there may be a/number of cells for 
one of more students that r^emajn empty. There ar^ several reasons why 
these cells have not been used: " — ^ 
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1), ^ If the instrucfiopal oB^ctive was ciompleted by the student(s) 

prior ta tlie beginning of the study, write ^tlje word; ^'BEfO-RE, " 
in the appropriate cell(s); ' , ' ' • , . 

.2) If work on instructional objectives has nojt been started by the 

.end of the study period, but will probably take place during this 
school year, write tbe word, ^'AFTER, *| in the appropriate cell(s); 

_3) A last reason for cells remaining blajfiH is because the pa,rticular 
objective doesn't apply or is not relevant to a particular student 
or group of students (i. e, , the student has not and will not work • 
on the objective this year). If this is not the case, then write the 
words, '*NOT RELEVANT*' in the appropriate cell(s). 

At this point, each cell in the Log should be filled with some 
notation. (If there are still empty cells, you should discuss this with 
your field staff member, when he/she picks up the Log during the final 
school visitation)* 

Conclusions 



Your diligence in following the /above instructions is of utmost 
importance to the success of this research project. As a paid member 
^.gj^the research team, it is hoped' that you will carry out your responsi- 
bilities with extreme care and promptness. If you should have any 
questions about how the Student Activity Log Kit should be used, please 
contact ypur assigned field staff member as soon as possible by tele- 

•a 

phone at: [ . 
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-Bt:- Matexia.ls Associated With th>e Log " 
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^STUDENT ACTIVll 
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:tivity log for math 
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STUDENT ACT4VIT 



Objective Objective Objective Objective Objective ""©bjective Objective Objective Objcctlre 
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tVlTY LOG FOR READING • 

[.••,■- ^ 

ke Objective Objectiv.e Objective Objective Objective Objective Objective* Objective Objective Objective Objective 





1 1 


\ '\ 


1 


1 1 


1 1 


1 1 


1 1 


1 1 


1 1 


1 


1 V 
















< 

— 1 iFi= — 










\ 

[ 


- 1 1 


I I 


1 


I 1 








1 1 


1 J. 


1, 


























I 


j 


\ 1 
































• 




• 










J 


1 1 


, 1 


1 1 




1 


• 




1 1 


1 1 


1 1 


• 
















• 










i 1 


1 












1 




1 1 


1 




1 1 


; 
























H 


f i 


1 I 
















1 


1 1 




> 
























1 1 


1 1 

* * 


1 


1 ' 










n — ^ 


i 1 






























1 


1 1 


1 1 






1 




1 1 


1 1 


1 


1 1 


: 








} 


















_LJ_ 






1 














1 


1 


— 


























1 1 


1 1 




1 1 

1 1 












1 1 


1 1 


1 " 


; 












* 














1 1 


1 




1 








1 




1 


1 1 


1 




• 






















1 1 


1 1 


1 


1 1 








1 


1 


1 


1 


\ 


























1 1 


1 


r 


1 




• r 


1 




1 1 


1 


1 1 


I 


















• 






r 


-rp^ ^TT- 


- 1 




1 1^^ - 




1 


-1 




\ >i'l - 


1 1 


1 1 


i 
































1 










1 






1 1 




























































< 





















Coding key for student activit-y log --math 



Teacher Behavior 

(What Teacher," Aid, etc. Does) 

' T'l? * -makes- oral presentation - 

T2. gives demonstration (shoNfrs and 
tells) 

;]f3. facilitates discussion 
T4. tutors 

T5. not actively involved (students 
work without instructor) 



Social Setting 

(With Whom Student Works)- 



SI. 
S2. 
S3. 
S4. 
S5, 
S6. 
S7. 

S8. 
S9. 

SIO. 

Sll. 

S12. 

SI 3. 

S14. 
SI 5. 

SI 6. 



regular classroom 
math specialist 
paid aide 
volunteer aide 
other adult 
no adult 

older student tutor (from 
another class) 

Entire class of peers (comp, ed. only) 

entire class of peers (comp. ed. and 
non-comp. ed. ) , 

large group of peers (comp. ed. only) 

(9 to entire* class) 

larg6 group of peers (comp. ed. and 
non-comp. ed. ){9 to entire class) 

small group of peers (comp. ed. only) 
(3 thru 8) 

small group of peers (comp. ed. and 
non-comp. ed. ){3 thru 8) 

one or two peers (comp. ed. only) 

one or two peers (corlip. ed. and 
non-comp. ed, ) 

no peers (i. e. , alone) 



Physical Setting 
(Where Student Works) 

Yl. at desk in regular classroom 

Y2. ' on floor in regular classroorp. 

rY3.' at table in regular classrpom 

Y4. in carrel in re'gular classroom 

Y5. at learning center in regular » 
odassroom ^ • 

Y6. on playground (outside school 
' ' buildings on school grounds) 

Y7. in math *'lab" (i. e. ; some 
place other than regular 
classroom where math 
instruction is being given) 

Y8. off school grounds 

Pupil Behavior ♦ 
(What Student Does) 

PI.- reads silently 

P2. reads aloud 

P3. writes 

P4. talks' 

P5. listens 

P6. observes (watches) 

P7. manipulated objects (other 
than for purposes'of 
reading and writing) . 
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CODrNG KEY FOR STUQENT ACTIVITY LOG - MATH^ 



AlnstructionaL Materials 

M, 1. , 

M 2. 



M 3. - 



M 4,_ 
M 5. 
M 6._ 
M 7._ 
M 8._ 
M 9._ 
M 10. 
M 1 l._ 
M 12. _ 
M 13. _ 
M 14. _ 
M 15. _ 
M 16. _ 
M 1-7. _ 
M 18. _ 
M 19. _ 
H 20. 



M 21. 
M'22. 
M.23. 

»" 

M 24. _ 
M 25. 
M 26. _ 
M 27. 



M 28. 



.'M 29. 
M 30. 
M 31. 

M 32'. 

I 

M 33 



M 34. , 



M 35. 

M 36. 
M 37. 
M 38. 
M 39. 



M 40. No Materials Utilised 
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ING KEY FOR STUDENT ACTIVITY LOG - MATH 



Instructional Objectives 



V- 



2. 



'b i 'I 



3. 



4. 



^ ^ 



5. % 



i HI 



7. 



8. 



9. 



ERIC 
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10. 


" ' ' ~ir 
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CODING KEY FOR STUDENT AdTIVITY LQP - MATH 



Instructional Objectives 



II. 



■' 12. 



13. 



14. 



15. 



16. 



f7. 



'it* 



18. ^ 



^ 19. 



20. 



ERIC 
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CODING KEY FOR STUDENT ACTIVITY LOG— READING 



Teacher Behavior 

(What Teacher, "Aid, .,etc . Do e s ) 



Physical Setting, 
(Where Student Works) 



TI. makes oral presentation 

T2, gives demonstration (shows and 
tells) . 

T3. facilitates discussion 

T4. tutors 

T5. not actively involved (students 
work witholoT instructor) 



Social Setting 

(With \Vaip"rnStudeht Works') 




SU . regular classroom 

S2. reading specialist 

S3'. paid aide 

54. volunteer aide 

55. other adult 

56. ' no adult 

57. ol<4fer student tutor (from 
;anothe,i^lass) - ^ 

S8/ entire class'^bf peers (cotnp. ed. only) 

.39. entire (cl-ass of peers (comp. ed. and 
fnon-comp. ed. ) 

SlO. large group of peers (comp. ed. only) 

^ (9 to entir-e class) 

Srr. large group of peers (comp. ed. and " - 
non-comp. ed, )1[9 to entire class) 

512. ' small group* of peers (comp, ed. only)- 

(3 tjxru 8) . ^ / 

513. small group of peers (comp. ed.fand 

noh-compc ed. )(3 thru'8) 

. SI 4. one or two p^ers (comp. ed.- only)'* ^ 

i SI 5.' one or two peers (comp'.^ed. and, 
^non-comp. ed. ) , 

*S16. no peers (i. e* , alone) 



Yl. 
Y2. 
Y3. 
Y4. 
*T5. 

Y6. 

,Y,7. 

Y8. 



, at desk in regular classroom 

on floor in regular classroom 

at table in regular classroom 

in carrel in regular classi'oom 

at learning center in regular 
. classroom • ^. 

on playground (outsid'e school' 
' buildings on school grounds) 

in reading ''"lalb" (i. e. ; some 
place 6th^r than regular 
classroom where reading 
"instriration is being given) 

off school grounds 



Pupil Behavior 
(What Student Qoes) 

PI.' reads silently 

P2. ^^reads aloud 

P3. writ^Ts 

P4. talks, 

P5. listens/^ ' 

P6. observes (Watches) 

P7. I manipulated objects (other- 
than for purposes of 
. ' .reading and writing) 
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F:.16 

23.4 



CODING KEY FOR STUDEI^^T ACTIVITY LOG - READING' 



Instructional Materials 

M 1. 

M 2. , 

M 3. 

— - -i^ ills 

M '4. . 

M 5. J 

M 6.^^ 

H 7._^ ■ 

M ' 8. , 

M 9. " 

M 10. _^ " 

M 1 1. ^ 

M' 12. - 

M 13. _^ ^ 

M 14. 

f 

M,15. 

M16. ' 

M 17. J 

M 18. 



M19._ 
M 20. 



M 21. 
M 22. 

_m:.23. 

M 24. 

M 25. 

M 26. 

M 27.. 
_ M 28. 
^•M 29. 
_ M 30. 
_ M 31. 

M 32.' 
_ M 33. _ 

M 34. _ 
M 35. 

M 36. 

» - 

.M 37..'_ 
U 38. _ 
M 39. 



M-40. No Materials Utilized 



ERIC 
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CODING KEY. FOR STUDENT ACTIVITY LOG - READING 



V 



Instructional Objectives 
11. ^ 



12. 



•7 



13. ■ 



14. 



15. 



16. 

♦ 



17. 



18. 



19. 



20. 



"V 



ERIC 
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SUGGESTED LIST OF MATH INSTRUCTIONAL 
objectives' FOR USE IN STUDENT ACTIVITY LOG KIT* 



1) The student will identify the digit corresponding to a specified -place 
^ ' value^in a giVen four digit numeral. , • 

2) .Given a five digit decimal numeral with one digit on the left side of 
the decimal point, the student will identify the digit corresponding 
to a specified place value^, ^ , 

3) , The student will write. a Roman numeral expression that corresponds 

to a specified natural number less than*»40. 

4) The student will indicate the. ratio solution to a simply stated word 
problem. * ^ * 

5) The student will indicate whether or not two given ratios are equal. 

6) The student will calculate the missing term in a proportion equation, 
statement. , . ' 

/-^ 

7) The studejnt will find the whole number coordinates of a given loca- 
.tion on a Cartesian -graph with one quadrant. : 

8) The student will plot the point of a given' ordered pair with whqle 
number coordinates. The point will be plotted on a single quadrant 

' Cartesian graph provided for that purpose. 

9) The student will find the integer coordinates of allocation o,n a full 
Cartesian graph. * 

,10) The Student will answer simple questions about information given 
in a pictograph. ' "^i^*" • V 




11)^ The student wil^f answer simple questions about information in a 
bar graph. / 

) The. student will answer simple questions about information given 
on a broken line graph. , , 

13) ^ The student will, answer simple questions about information given 
in a circle graph, ' r ^ ' 

f4) - The student ^yill indicate Whether a given syllogism is va.Ud or- 
invalid. - ^ 

-'-'These objectives are extracted from a more comprehensive list pfe- 
.^pared *by the Instructional Objectives Exchange/ 
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Given a set containing from zero to "nine pictorially represented 
simple eliments, the student will give the cardinal number for the 

Given a set containing from one to three pictorially represented 
simple elements, the student will select. a subset of the given set. 

Given two disjoint sets, the student will select the set which is the?, 
'union of the two. • ' 

•# 

Given a number line 10 units long with each unit position marked 
^off> the stadent will be able to select the number which, corresponds 
to an indicated unit of the number line. 

Given a whole number less than '100,' the student will indicate whe- 
ther the number is *'even numbe9^ an "odd number" or 
"neither". 

Given -a list of three to five cardinal numbers, the student win SBle< 
the rearrajigement of these numbers which gives the numbers in 
ascending order of their values. 

Given a whoje number from two to ten, the student will select 
multiple of the number. 

Given a natural number less than 50, the student will select/a factor 
of the number. , ^ 

^ . - r .... 

Given a diagram of a circle, rectangle, o r square whii^h i/ gnh^ 
dividend into from two to nine congruent sections, at least pne of 
which is shcLded. the stndf»nfc will ^ho'f^a^l■^^r^ ^rMJAf 



which is shided, the student will select the'fraction 
t\ie shaded o^ the given diagram. ^ 



describes 



Given a common fraction with eithfer its numerator or denominator 
asked for, thfe-student will select that requested part of the fraction. 

Given a set of equivalenflractions, the student will selem the num. 
ber/Iine on which the position indicated by the arrow corresponds to 
the^ rational number that is represented by the, given set o^f fractions. 

■ ' ^ ' ' / . ■ - „ . .... - 

Given a common fraction, the .student will select its reciprocal. 



For a given simple ^decimal fraction, the stude^it will write an 
equivalent coigrimQn fraction^ ' . • r ' 

The student will be able to solve additi9n problems«?involvj^g^twq^ 
one-digit numerals. * • ^ ^ 



-'I 
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The student will bfe able to solve an addition problem involving a 
two-digit numeral and a one- or two-digit numeral, not requiring 
regrouping. 

The student will be able to solve a word problem whose solution 
requires ^addition with one- or. two-digit ^lumerals, not requiring 
regroupiiig. ' » ■ ^ 

The student ^^11 be able to solve an addition problem requiring 
regrouping ,^afiid involving a yiree-digit numeral and a one- to 
threS-digif numeral. 

The student will be able to solve a column addition problem involv 
ing at mast, five whole numbers. 

The student will be able to solve an addition problem involving two 
simple mixed numerals.* 

The student will be able to solve an addition' problem involving a ; 
four-digit decimal and , another;, decimal with four digits or less. 

The student will be able to solve a subtraction problem with a ^ 
noti-negative answer, involving two, 'one-digif numerals. 

The st,udent will be able to solve a subtraction problem with a , 
noh-negative solution not requiring ^^•egr6uping, involving a two- " 
digit numeral and a one- or two-digit numer^al. • 

The student will be able to 'solve a word problem with. a non- 
negative solution, requiring p»egrouping, and involving subtraction 
with two digit numerals. • f ' 

The student will'be able to solve a subtraction problem requiring 
regrouping, \vhose^answen is non-negative, invol^^g a four di^it 
numeral andf another numisral with four digits or les^s. 

The student will be able to solve a subtraction problem with a, 
non-negative answer involving two simple mixed numerals. 

The stu'dent will be able to say the names of whole numbers less* 
than 100. . 
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SUGGESTED LIST OF READING INSTRUCTIONAL 
OBJECTIVES FOR USE^ STUDENT A^IVITY^LOG KIT* ^ 



/The student will select from two a It ernat ive pairs _of letters the 
pairs that'match a given sample paiiL of letters. * 

Given a serjie^^ of three- letter , combinations, one of y^iich is a 
sample, the student will select the alternative letter combination 
-which matches the sample. 

Given sets of pictures of objects, one of which is a sample, the 
student will be able to mark the alternative picture whose name has 
the same initial consonant sound as the sample. 

Giv^n sets of three pictures of objects, one of which is a sample, 
the student will be able to mark tlie alternative picture whose name 
rhymes with the name of the sanple. ^ 

Given sets of three pictures of objectives, one. of which is a sample, 
the student will be able. to mark the alternative picture whose name 
. has the final consonant sound as the sample. 

Given sets oj^three pictures^ of objects, one of which is a sample, 
the studeit will be able to mark the alternative picture whose name 
has the same medial vowel as the sample. 

Given an orally pronounced one-syllable word, separated into it^ 
initial phoneme and its 'ending consonant sound, the student' will be 
able to pronounce the word. 

The student will be .able to serec tlrom a g roup of pictures the pic- 
ture whose name be^^^ with' the sound of a given letter. 

Th^ student will be able to select from a group of pictures the pic- 
ture \yhos,e name ends with the sound of a given'letter . 

The student will be able to select from a group of pictures the 
picture whose name begins with the sound, of the given blend, 

' 'V - , • 

The student will be able to select from a group the word which rhyme 
with ct spoken word. ' . , 

The studer^t will be able to select ir-om-a^FOup-ef^-ctures of objects 
the picture ^ybose name contains the same short vowel sound as. a . . 
'given eanlple word^ \ * . ' - 



These objectives are extracted from a more comprehensive list 
prepared by the Instructional Objectives Exchange. 



/ 
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13. The student will be able to select from a group of pictures of 
objects the picture whose name contains the sound of a given 
digraph. 

14y The student W 11 be able to select the compound \yord from a list 
of three words. 



\ 



15. The student will be able to select from a list the phrase equivalent 
\ --to a given contraction. » • 

16. The student will be able to select a base word from a list of words. 

17. The student will be able to select from a group the_word which begins 
with the same consonant blend as an unfamiliar spoken sample. 

18. The student will be able tO select from a list the word containing a' 
long VoweL 

19. The student will be able to select from a list the word which has 
the same vowel sound as that of a written sample with an r-control- 
^ed vowel. 

* ' <• • 

T^-»,^*?0. ^The student will be able to select from a list the word whose vowel 
sound is the same as that of a sample having two consecutive. vowels. 

# ^ i * 

21. The student will be able to select from a list the digraph which is 
found in a- spoken sample word. 

22. The student Will be able to select the form of tbe word which best 
» completes a given sentence. 

23. The student will be able to select frorn a list the word which con- 
tains a silent letter, ^ 

24. The student will be able to select the number of syllables found in 
a given word. ' 

*25.\ The student will select from several written topics, the one which 
best expressed the .main idea of a given picture. 

26. Given three statements, the student will select £lie most general 

» statement. ' • ; ' . 

27. The student will be able to select the statement which ^^xpresses 
the moral of a one paragraph selectipn, 

28. The student will select from several statements tKe one which best 
' 'expresses a factual generalization which can be drawn from a one 

paragraph factual ^s'election.' 
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After reading a paragraph containing information about a particular 
^^sitruation, the student will be able to infer the situation being des- 
cribed and select the sentence conipletion that identifies the situation. 

Given written instructions or a simple story involving a series of 
events to be. read aloud once, the student will be able to select from 
three columns listing the events or instructions in various orders, 
'that column which reflects the sequence as it appears in the story. 

The student will cor rectl^*^ identify the sequence of three sentences 
by determining order from tense and words that signal order. 

Given a written sentence containing a subject pronoun, the student 
will identify the pronoun referent by selecting from three options 
a picture that indicates the sutiject of the sentence. 

Given a written sentence containing^^a subject pronoun, the student^ 
will identify the pronoun referent frpm a set of three options. 

Th e stud^ent will use the context of a selection to identify from among 
at least two correct definitions for a wo^d , the definition which is 
appropriate for that contextual setting; ^ 

Given a simple' written negative statement, the student will be able 
to select from several choices ^he positive expression which is 
opposite of the first sentence^ 

Given a list of one- syllable words, containing both long and short 
vowels, the student will be able to identify :^Vhic\h words- havVe long 
and which words have short vbwel sounds. 

Given sets of sentences, each with a mis'sing w.ord and an adjacent 
word, the student will be able to write the correct passive form of 
the adjacent word in the blank. 

* . \ ' . * • 

Given a randem list of capital letter s the student will be. able to 
identify the pame of each letter. • , 

* • 

Given a random list of lower ca°$^ letters the student will be able 

to identify the name of each letter. * ' 

Giv^n a random lifi?t of letters, containing both vo^Xr^ls. and conson- • 
ants, the gtudeht Will be able to identify which letters are consonants 
and' which are vowels. ^ 
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INDICES OF THE EIGHT DIMENSIONS OF ^ , . 
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APPENDIX G: SCORING AN^D THE DEVELOPMENT OF INDICES OF THE 
EIGHT DIMENSIONS QE^JNDIVIDUALIZATJON/ 
STANDARDIZED INSTRUCTION 



These variables are' measured using data obtained from the Student 
Activity Log and the debriefing session of Teaqh^r Interview II. 

A. Content . . ^ • 

A classroom instructional program should l^e considered to be indi- 
vidualized ;6r standardized with respect to th« content difmension to the 
extent that different objectives are worked on by different students in the 
class as a function of individual diagnostic -based prase riptioil. From 
the Logs the objectives applied to each student are ascertained by noting 
which objectives, if any, have been marked '^not relevant'* (see Instruc- 
tions for Student Activity Log Kit in Appendix F). The extent, to which^ 
different students work on different objectives can thus be as-^eissed by 
the ratio of the number of different sets of objective's marked ^not rele- 

'a ' » * 

vant" to the numiber of students in the classroom. From* the ac^rompany- 
ing interview the basis for assigning objectives to students is ascertained. 
This can vary from diagnosis of and .presx:riptions for individual students, 
individual or no'-diagnosis with prescriptions for iTistructional groups to^, 
individual or no diagnosis with prescriptions for the entire class. These > 
represent the three major categories of diagnostic-based prescriptions: 
individual, sub group.* and entire class. ^ 

/ ' ■ . 

B. Sequence ^ y . - 

A classroom instructional program is considered individualized or 
standardized with respect to the sequence dimension to the extent that 
different students work on a|^iv€5n set of instructional objectives in 
different sequences as a ^i*e^^u\t of iiidividualjdiagnostic -based prescrip- 
tions. From the *Log^ iii^ sequence of prodeeding through objectives for 
each student can be pbtained by u%ing the "beginning date" notations to 



or^dcr objectives. -The ratio of the number of different sequences over 
the number of students in the class proyic^es the measure of the*extent 
to which different students .work on a given Set of objecHves in different 



sequences. F rom the accompanying interview fhe'basis for assigning 
sequences of objectives to students is ascertained, providing information 
(as with the content dimension) as to, whether an individual, sub group, 
or entire class diagnostic-based prescription obtains. 
.C. Rate ■ 

A classrod^m'is considered individualized or standardize.d. with 
respect to the rate dimension to the extent that different students are 
alloted different amounts of time in proceeding throu'gh given objectives 
a's a result ^^individual diagnostic-based prescriptions. From the Logs, 
using the "number of hours*' spent working on dbjectives.^ the ratio of 
different time allotments to number of students i:an be assessed for each 
objective. The ratios for all objectives can be'^averaged. providing a 
measure of the e?ctent to which different students are alloted different 
amounts of time in proceeding through given objectives.' Data from the 
accompanying interview indicates whether individual, siib' group, or 
entire class diagnostic-based prescriptions occur. < 

D- Materials, Physical Setting. Social Setting. Teache r Be havior. 
and Pupil Behavior , ^ ' ^ 

A classroofm^is considered to be individualized or standardized 
with respect to each of these dimensffcns to the extent that different, 
materials, physical settings, social settings, teacher behaviors, and 
pupil behaviors are associated with students working on given instruc- 
tional objectives as a result of diagnostic -based prescriptions. 'From 
the Logs, using the appropriate codes, the ratios oi the nurtiber'^f > 
different sets of materials, physical settings, social settings, teacher 
behaviorp. and pupil behayiors to the number of' students can -be assessed 
for each objective. The respfective r.atios for all objectives can be " 
averaged, providing a measure of the extent to which different matt^fe rials, 
physical settings, social settings, teacher behavibrs and pupil behaviors 
are associated with different students working on given objectives. And ' 
as with the other dimensions.- data from the. accompanying interview 
indicates whether individual, sub group, or entire class diagnostic^ 
based prescriptipns occur. • , 
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TELEPHONE SCREENING GUIDE 
Interview Schedule: Teach-^rs 



My name is. . I'm calling for ' • • . . • 

We're working on a project /unded by the National Institute of Education 
to investigate instructional practices that enhance the math ^nd reading 
achievement of students in compensatory education programs. 

Your classroom is one of many which has been'selected for possible 
inclusion in'this study. We are interested in obtaining a preliminary 
description of how your and" other teachers' classrooms oper^ite. A 
div/erse. group of classrooms will be more throgouhly studied at a later 
date. . ' . . . ^ , • 

We tinnk that this study is an extremely important one, potentially 
li^yipg- 3L major impact on congressional actions as well as providing 
useful information to educational practitioners. We hope that you will 
cooperate in this important endeavor by ^giving us^aptroximately 20 
minutes of your time xo answer a few questions^ ^ jj^^ ^ 

r 

Do you have any questions before we begin? .y \ 



School: ^ Telephone 

Address: j ^ 



(Number atnd Street) 


(City and State) 


Respondent's I^ame: 




* * 

Interviewer's Name: , - 


Length of Interview: 


Date: " ' 


Interviewer's comments (cooperativeness, 

: C - " . 


etc. of respondent): 
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.^Couid you teU me how many, students you have in your class? 

• ' X 

Do you know (approximately) how.'mariy of your students are 
"target" com'pensatory education (e. g. , Title I Program) 
students? . . . ^ . 

Yes, how many? ' . . 



No, I don't kno 



^Not certain how many such students. 



_I don't tKiVik there are any such students. --- pUESTION ^ 



SKIP.TO . 



Do any of these compensatory education students receive any of 
their, math (reading) instruction in the regular classroom? (If 
"YES") Who usually is involved with their instruction? . 

Math Reading ' . > 

* no. 

1 • ^ ' (1) Na • , 

' ,L (2) Yes, I (the regular teacher) 

'. ' . (3)^ Yes;janaide * - \ 

• ("^J Yes, another teacher (what is his/her job tit I 



(5)^"lf^pitKer (specify): 



Do any of the target*' compensatory students receive any of their ^ 
math (reading) instruction in spme o^ther setting? (If "YES'^) could 
you explain'?. ' ' 

•Math — ^ JReading , ^ 
: » • (I*)* In ^ speciaJ^labV class or math (reading) 



room. 



(2) Special J4ab"cl^ss, but not only 'for -com- 
pensatory education students. 

(3) Other (s^)ecify); 



Now, like to ask. you about 'how your class as a whole is organized r 
for instriictioria.1 purpose s^* 

3. ^ * 'First, We have found *that many teachers have some^ set of bbjec- 
* " tives that guid^^eir instructional efforts. Some teach ersf work . 
from a formgil written list of such objectives which must hi # 
followed; other tel^chers have a list of objectives but they iteep it 
"in their heads'. " Do you orjganize your teaching efforts in math 
(reading) around SPECIFIC instructi*onal objectives ? 

Math *' Reading " * * ^ ^ ' 

- ' " (1) No objectives' (INTERVIEWER: Probe to be' 

certain' t^ien thank ^'es•pondeht Toj5 their coop- 
^ : ' eration and terminate interview. ) 

• - * ' (2') Yes , a 'formil Vritten list (wl\o generated 

it?) - * , ^ ' 



(3) Yes, /'keep*objectives in n>y head. 
(4} Yes/ Other (specify): 



3A. Could you give me some examples of MATH (READING) objectives? 

* ^ ■ r 

(INTERVIEWER: Help r,es|ibndent identify 2-3 objectives^ f6r both 
MATH' and READING. Guidance should be given 
, \ to obtain objectives that are 1) specific , pertaia- 

» - ^ ' ing'to insfruction that normally requires 1-2' 

' / wcj^ekato comolete and 2) behavioral, descril^ing 
something that students would dp, ^and 3f) focus 
^ on one student . EXAmI^I^E: *'The student will 
^ * be able to select frohn a ^rpiip the word which 

rhymes with a spoken word.,) / , ^ . " - 

1. - " • ' 



M 

A. 

t' 

'H 



2, * 
3. 



ERIC 



. ,H-4 



250 



E 
A 
D 
I 

N 
.G 



In thinking about the math (reading) objectives- just fisted as well 
as other such objectives that apply to an,y students in your class- 
room, would you say that 2^11 of ycmr students work on the same 
set of objectives or are there objectives, that anply only to some 
of your students. (Check onp. for both' math and jreading)' 



Math > . Reading 



(1) . All students work o'n'the same- set of . 

* . ^ objectives. ' . 

(2) >11 students work on a "core-set" of objec- 
. tiVes, at least some studJjrtts wofk>on a few 

other objectives. ' ^ 

(3) All students within an instructional gro.up 
work on the same set of objectives; fnter- 
'group differences 

'(4) All st lid, en^- within an instructional group" 
work on a "core- set" of objectives, while 
at least somQ,of th^e students in the group 
work on other objectives! major intergfoup * 
diCferehces. ' * . 



(5) All students work on sigfiificantly different 
sets of obj.ectives, although a few objectives 
are applied to most of the students. - • 

(6) All students iwS^^k^h completely different 
sets of objectives; no^students ever work on 
the same objective' ^ . 

{INTERVIEWER: Probe ,to,make certain 
^that no objectives are applied to rriore tHan 
^'one student in the class even over the, course 
of a school year. IF THE PROBE DOES 
NOT POINT TO A DIFFERENT RESPONSE, ^ 
thank the respondent tor.his /her cooperation 
and terminate interview. 
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Math^ Reading 

. (7) Other^(specify): 



Can you tell me how these objectives are set? (Check one for 
both math and reading. ) 

Math Reading ' • 

; (1) Prior'to start of year, administratoil^S or ^ / ^ 

. teachers 'prescribe the set of -objei^tives- thsUfc)" 
the class '(gra<ie level) will work on. * 

' ' (2) Instructional* materials or conrunercial pro- 

grams prdvide^a set of objectives that are ' 
^ applied to students using them. 

• Students decide (via a vote, etc. ) the set of 

' ' - objectives to be worked on by the class. 

< ^^(4) Teacher diagnoses students and prescribes , 

^ .%,'l>i^'' the set of objectives that the class will work 

' *' on. . ' * ' 

. . (5) Teachir diagnoses students and a'^signs 

them to instructional group for which a s^t 
of objectives is prescribed (group sizes ): 



(6) Individual students choose the objectives 
that they'will work on. 

(7) Teacher and student negotiate a *|contract, 
specifying the s'et of objectives to be worked 
on. ' ' ^ . \ * • ' 

(8) Teacher diagnoses students and prescribes 
which objectiverS they shquld work on as 
individuals. -o . 

(9) \ Other (specify).; / 



With regard to, the math (reading) objectives on which several 
-or all of your students work, 5o these students proceed through 
this set of objectives in the same order or do, some of these 
students work on objectives in di*fferent sequences? (Check for' 
both math and reading) . . . 



Math Reading 



0 



(1) All of these students proceed through the 
set of objectives in the same order. 

(2) Most of the students proceed throughJ'.the ' 
set of objectives in the same order, some* 
in different sequences. 

(3) All students- within instructional groups pro 
ceed through the set of objectives in the 
same order; intergroup differences^. 
(NOTE: This'implies rthat the instructional 
groups work on a corrrPnopn -set or subset of 
objectives. ) ' " . 

(4) None (or very few) of these students work 
on the- set of objectives in the same order. 

(5) Other (specify):^ 



How is the sequence of objectives determined? 
Math Residing 



i 



(1) Sequence is determined by subject matter, ^ 
instructional materials or teachers' and 
administrators* decisions prior to the be- 

, ginning of the year. 

(2) Students decide (yia a vote, etc. ) the se- 
quence on which the objectives will be ^ ^ 

worked by the cFass as a whole. 
^ ' ^ 

* ' ' s 

(3) Teacher diagnoses students and prescribes 
^the sequent e on which objectives will be 
worked for the entire class. 
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Math ' Reading ^ 



(4) Teacher diagnoses students and assigns them 
to an instructional group for which the se- ^ 

\ quence of objectives is determined (group 
sizes): ; 

(5) . '.Individual students choose the sequence on 

which they will work on objectives, 

,(6) Teacher ^nd student negotiate' contract" 
specifying the sequence for working on 
objectives,- ' , , ' ^ 

(7) Teacher diagnoses «tudentfe and prescribes 
' ' the sequence'on which objectives will be 
worked on 



(8) Other (specify): 



Still thinking about the math (re^dit^g) objectives on which steveral* 
or all of your students work, are aW students allotted the sa.me 
amount of time in wojrking on particular objectives or are some 
stuHe^ts givdn more ti,me than others? (Check one for both math 
and,rea4ing. ) ' ' ' ^ \ 

Math Reading ^ • 

(1) -All students allotted the same amount of time 

\ ^ (2)" Mbst students allotted the same amount of . 
I ^. 'time, A' few/given* morefiOr i;e§s time ' ' . 

# , (3) -All students! within a group allotted same > , 
. TT.;- . 'drijiount of time; inter gjroup difference. ^ 



.(.4) Most students with a gr'oup allotted same - 
amount of tirne;:lnfergroup. differences, 

(5j 'No students are allotted the. same amount 
• Of time, eafch 'student given a different time 
allotngient. 

(6) Other (specify): 2 
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What determines the amount bf time that is allotted to students 
to w.ork on particular objectives? (Check one for both math and 
reading. I 



Math Reading 



(1) Time allotted is determined by instructional 
materials and/or teacher /administrator 
decision prior to beginning of the school 
year. ' ^ . 

(2) Stude nts ^ decide (via a vote, etrr) the amount 
. of time that the class will spend in working 

on particular objectives. 

(3) Teach.er diagnoses students and'prescribes 
ir J>ow much time the class will spend work- 

, ing on paurticular objectives. 

,(■41) Teacher diagnoses students, ^t^.,\and 

assign^ theVrTto an instructional group for. 
wh'ich the length-of* time spent in wording 6n 
given:objectiv9S is determined. 



(5 
.(6 

^ (7 



Itadividual students .^ork on particular ob- ' 
je-ctives until they have completed them. ♦ 



'"^ea-cher' diagnoses students and allots time 
for working on particular objectives accord- 
.ingly. ... 

Other (specify): 



Again, thinking, about the math (reading) objectives on which sev- 
eral or all of your s 'udents work, dp all'of these students use the 
same instructional nliat e rial s*^ when working on particular objec- 
tives or do some of thes« stQdents use different materials V ,^ 
(Check one for both iiath atnd reading*. ) - *• 



Math^ Reading 

' (171-All ^students useirhe same materials. 



(2) .^ost use the same materials, some use 
iiffer^nt ones. 



Math ^Reading 



(3) All students within group use same materi- 
als; intergroup differences, 

(4) Most students in group use same materials; 
intergroup differences, 

* I 

(5) None of the students use the same materials, 
all use different ones. ^ 

(6) Other (specify); ' 



7A, For particular objectives how{ are instructional materials selected? 
Math Reading 

, - (1) Materials determined by teacher and/or 

* . ' ' administrator decision prior to beginning 

of school year. / 



(2) Students decide (via a vote^; etc.-) which 
materials will be used wh^n working on 
particular Objectives. / 



(3) Teacher, diagnoses students and selects ' 
the materials to*^Q usedr^^mmonly by the/ 

• entire class'. * 

(4) Teacher diagnoses 'students apd assigns them 
to instructional groups fo^r which instruc- 
tional materials are selected.' 

^ (5) Individual students choose the materials they 
will use when working on particular objec- 
tive s . . 

_ (6) Teacher and student negotiate '^contract'* 
specifying the materials to be used. when 
working givpn objectives. 

(7) Te&cher diagnoses students*and prescribes 
for individuals which materials will be used 
p^ccordingly: ^ ^ ' 

(8) Other (speci'fy): [ ' 
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Additionally, with respect to. the math (reading^, objectives on 
which several or all of your students work, do you act basically' 
the sa;me way when dealings with all students or do you do different, 
things with different students. (Check one for both math and 
• reading) • ; 



Math Reading 



(1) Teacher does ba&ically the same thing with 
^11 students who are working on particular 
objectives* ; 

(2) Teacher does^b^^&rcallyfhe'same^-w^th-mo^ ' 



(3) All students within an "instf lictionVll^ioup ^.'I^^^ 

are treated in the same mjar\i3§x.JI?y.Jhe. : [ 

. -.teacher; intergroup differ enceiS* fvf=>^ 

(4) Host students within an instructional group 
are treated in the sai3ae.xaarLner,Usjaxne...^.'~..-* 
intragroup differences^ and significant 
•intergrouip differences*^ " 

(5) Teacher does basically different things, with 
almost every student who is working on 
particular objectives. 

I* . • ' ' ' .t 

(6) Other (specify); • 



How do you determine how you should act when dealing with 
various students? (Check one for both math and .reading. ) 



Math Reading 



(1) Teacher has developed with experience tHe 
. best things to do with all stud'^nts who a^te 

working on particular objectivePs* * *' , 

' I . 

(2) Students' decide (via a vote, etc. ) whkt kinds 
of* things, the' teacher should do in working . ' 
with the entire clags. 



(3) Teacher diagnoses students and decides* 
what wolild be the beat things to do whep, 
working with the entire class* ' / f 
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Math ' Rfeadiag 



(4),. Teacher diagnoses students -and assigns 
them to instructional groifp's for which the 
things that the teacher does in working with 
students is determined, - 



(5J Individual students determine (by asking) 

what the tecicher does in working with them. 

'(6) , Teacher atid student negotiate ''contract" 

specifying the things that- ill e teacher should 
^ ;2^Q^jua working with the student on particular 
-f-^ objectivelB» 

(7) Teacher diagnoses students and determines 
the best things to do with each student who 
'is forking on particular objectives. 

(8) Other (-specify): _/ 



> ♦ 



9. 



i 

0 

I 



An'S'ther^question about the math (reading) objecli^ves!^^ which sev- 
eral or all of your students work, do all of these 'students work on 
particular* objectives in the same physical settings^ or do spme of 
these students work it^ different settings? 'For example, do some 
st\i4enH:s work at a desk, while other w6rk on the floor and still 
Others* wopk Somewhere outside the classroom or perhaps off the 
school grounds- ' (£?heck one for both math and reading. ) 

Math . Rea'dine" - " / 

* '(1) All work in. same physical setting. 

^ (2) Mpst work in same^^hysica,I setting*, some 

/\ T ^ itt difC^erent ones. ^ ^ - 

• (3) AH students in grpup worK in same physical 
• '^kettirig; intergroup differences. 



4 
* 



0, 



(4) ^/ivlost students in group work in same physi- 
ocal gettiiig;inteijrgroup differences. 

. (5)5 Non^ |tvoTk/in same physical setting, all 
J * workHn d^ifferent ones. 

; (6); OthelJ^^'ecify) 

> . . .- / '\ 



1-^ 



0 ♦ 



9 V 



0 



How is the physical setting determined foi^students working on, 
particular objectives? (Check onq.for both rnath and reading. 



Math Reading ' 



(1) Limited facilities, sckbol regulations/ or * 
subject matter determine whe^re students • 
work ' • 

(2) ^ Students decide (via a vote, etc. ) where the^ 

entire class or'group will work on particular 
objectives, 

(3) ^ Teacher diagnoses students and determines 

where the entire class will work on particu- 
lar objectives. 

(4) Teacher diagnoses students and assigns* 
them to an instructional group for whvch the 
setting is determined, 

(5) Individual students choose where they will 
work on particular objectives. 

(6) Teacher and' student negotiate "contract" 
specifying where particular objectives will 
be worked on. * ' ' 

(7) Teacher diagnoses students and prescribes 
for individuals where they will woik on par- 
ticular objectives. 

(8) Other (specify):^ 



Furthermore,, with Vegard to the math (reading) objectives on 
.which at least several' students work, do allof these students 
work on particulal* objectives in the same' kind'of social settings 
or do some students work alone, while others work in small 
groups, or in' larger groups? <Check for both math and reading. ) 



Math Reading 



(1) All students work in the sam^ size group 
(the entire class). 



H-13 

258 



Math Reading 



(2) All student work alone, 

(3) All students within an instructional group, 
J work together, thus all students in the class 

*work in approximately the same suae group. 

(4) Most students within, an instructional group^ 
work together, though a few work lindividuj 
ally or in subgroups, 

(5) Students work in many different si 
groups, which are created iSt wor 
particular objectives and not for a 
in a subject 

(6) Other (specify): 



zed 
^ing on * 
all work 



lOA. 



low do you determine who is grouped together when working on 
jiarticular objectives? (Check one for both math and' reaching, 

lath,^ Reading * , 



(1) , All students who are working on a giyen ob- 

jective work together. . * ^ 

(2) Ability groupings determine the other stUT 
dents v.'ith whom a. student works on par- 
ticular objectives, 

(3) Ability groupings determine the other stu- 
dernts with whom most students work on ' 
particular objectives; some students work 
together because they like each other or 
because teacher thinks they work well 
together. 



(4)* All students choose who they will 
on particular objectives. ^ 



work with 



.^5) Teacher diagndf es students^ahd decides on 
the basis of. something other than ability 
' who is grouped together to work on pax'ticu- 
lar o)Djectives. 
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Math . Reading * ^ * • • 
, * • (6) Other '(specify): . 



Finally, with respect to the math (reading) objectives on which 
^t least several students worK,.d.o all of these students engage 
in the_ same kind of activity of do different students do different 
kinds of things (^. g. , reading vs. ^Jvriting or talking) while work- 
ing on particular objectives?- (Check ohe for both math-and 
reading, ) * • - 



Math ^ Reading 



^ (1). All students workifig on the ^me objective 
. engage in the same activity. 

(2) Most students workihg onjhe same objec- 
tiye engage in the same activity; a few do 
different things; 

(3) All students within instructional groups 
engage in the same activities when working 
dn particular objectivesrir\tergroup differ- 
ences in activity tor those' working on the - 
same objectives. 

(4) Most students within instructional grbup^ 
engage in the same activities; some 

'intr agroup differences and significant 
intergroup differences. 

(5) N5ne (or few) of the stu4ents working on 
given objectives engage in the sarpe activi- 
ties; most or all stude^nts do different things, 

(6) Other (specify): - 



ow do. you determine what kinds at things students do when vvork- ^ 
g on particular objectiVes.'\ ^ - ' ' •\< 
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Math Rfeading .) 



' ( 1 ) ' A ctivity <lete rinlned^>y ,matpxxals or teacher . 
and/.or adrrilnistr^tor decisigri pri^r tp.'siart 
of'year,,. % ' / " '^^ » ... 

. ' . : \ . ; * / ^ y • . * ^ 

(2) Stuplents decid,e (via a .vote, etc.) What /'^ 
activities* tile class will^do when working on 
given objectives, , • ^ 

(3) ' Teacher diagnoses students and prescribes 

tiie activities that the entire class will- • 
engage in tQ^gether. \ 

(4) Teacher diagnoses studen^ and assigns them 
' t^o an instructional group f^iwhifch thet type - 

o{ activity to be done while working on given 
objectives is prescribed. 



(5) Individual students, ^choose .the„ type of activity 
to be don|^ in.woirking on given objectives. / 

(6) Teacher aftd student negotiate ^*cpntra<:t" - 
specifying the type of activity t9.>e done in 

^-working on particular objectives. , 

*(7) Teacher diagnoses ptudents and prescribes 
for individuals the type of activity to be 
4one. in working on particular objectives 

'(8) Other (specify): 



Xhat concludes this interview. THANK Y01^.^*^^5y-MtJCH FOR YOUR 
'TllvIE AND COOPERATION! ! ! After tlj^a-ifet^ph^^ screening has been 
cornpleted atid final decisions aboja-tdJlie^^^ been made (by the 

beginning of next school yeaj:^^^'*^^^^ be notified'if your classroom 
; has^eeh selected £orfipKifeJ^^ study anjd will be given further 
"instructions aboyl^'^fudy aho^ your involvement'in it. 



Do you have .any further questvc 
QOO'PERATrai 1 1 ' 



THANK YOU CA GAIN -COR YOUR 



. r 



List of Potential Sample 3rd Grade Classrooms 

■« from Pilot Telephone Screening : , . 

(Corresponds to descriptive information in Exhibit. HI- 1) 



•11. 

.12.. 

13*. 
14. 

15. 
16. 
17. 
13. 
19. 



1. Wendy Woehler, Maple Elementary, Rockford, niinois 

2. Betty' Stoggens*, Baskin Elementary, San Antonio, Texas' s 

3. ^ Helene August:irie, Lock^tt Elementary,^ New Orleans, Louisiana 

4. Polly Loviji, Westminister Elementary, Westminister, South 
CalroUna ; , * ' ' * 
■ Phyllis Fr.eedman, 'Coggeshall Eleni'entary, Ne,wport, Rhode 
TsTarici "~ . — ^=^^ -- =-=--5-; 




Mary Bell, Alexander Hillsboro Elementary, Tampa, Florida 
' Anna Mitchel, Siiiclairville Elementary, Sinclairville, New York 

• Pella Hoggan, Blackshear Elementary, Houston, Texas' 
Marvin Barcken, E^qalante Valley Elementary, Be'ryl, Utah 
Daniel Levy (Principal r,eporting on strikiYig teacher's classroom). 
Public School #11, Bi-ooklyn, New York 

. Phyllis Brown; Melvin.H., Kreps Elenrientary, ^last Windsor,- 
New Jersey *• • * 

Christine Powlsen, Soiifch Park Elementary, Los Ang6les, California 

Jill Hewitt, Thomas Johnson Elementary, Baltimore, Maryland. ^ 

* 

* Emma 'Jackson, New Augusta Attendance Center, New August^, 
Mississippi . • . 

' Su;sanne Pearson, Riiiihels Elementary, Runnells, Iowa j ^- , 
Phyllis Dotson, Century Park Elementary, Inglewood, California 
Gayle Behm, .Roosevelt Elementary, Scotts Bluff, Nebraska 
Kathy Brvinnex, Thornton Elementary, Thorntcn , Colorado 
.Terria, Bbrkin, Nichols Elementary, Detroit," Klichigan 
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^i-^p^T^ebecca K^rClu-re, Daniel Weiss Elementary, Indianapolis, 
Indiana 

21. Gloria Kellan, Iowa Maple Elementary, Cleveland, ' Ohio 

22. M^ Neal, Morvia^^Primary Schgol #'105,, Baltimore, Maryland 
_ — Z3^~~J^l Meirr^Gasady Elementary, ~Des Moines, lov^a 

24. Ellen Doyle, Lincoln Avenue Elementary, Springfield, Massachusetts 
Patty Bowen, Ridgecrest Elementary, Phenix City, Alabama' 
Sara Bjcody, Wintonburg Elementary, Bloomfield, Connecticutt 
Thfer.esa Szwabo, Walnut Grove Elementary, Ferguson, Missouri * - 
Marcia Goldstein, A. F. Herrd^on Elementary, Atlanta, Georgia 
John Thigpen, Camelia Elementary, Sacraijiento,. California 
Betty Smith, James Wadsworth Elementary, Chicago, Illinois 



25. 
26, 
27; 
28. 
29. 
30. 
31. 



Ruby Williams, Valley Springs Elementary, Valley Springs, 
Arkansas ' . . , . 

32*. Yevette Witkins, 12th Street Elementary,. Milwaukee, Wisconsin 

33. Ramona^Kirby, Soroco Elementary, Yampa, Colorado " • * 

34. Nancy Yonkee, Bfoadus Elementary, Broadus, Montana . 

35. ' Elaine Wilson, Broadway Elementcyry; Venice, California 

36. ' Kathy Briggs, Robert K ennecjy Elementary, San Jose, California 

37. Jackie Hall, 'Myrtle Tate Elementary, Las yegas^ Nevada 

38. Diane Shope, Alderman School, Greensboro; No'rth Carolina ^ 
•39. Ruth Bayers, 18th, Avenue Elementary^/ Newark, iMew Jersey 

40. Vera Greenwood, 116th Street Elementary, Los Angeles, California. 

41. Carolyn Szymanski, Rose Schoorl, Detroit, Michigan . 
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